Category Archives: ECM

enterprise content management

AIIM Information Chaos Rescue Mission – Toronto Edition

AIIM is holding a series of ECM-related seminars across North America, and since today’s is practically in my back yard, I decided to check it out. It’s a free seminar so heavily sponsored; most of the talks are from the sponsor vendors or conversations with them, but John Mancini kicked things off and moderated mini-panels with the sponsor speakers to tease out some of the common threads.

The morning started with John Mancini talking about disruptive consumer technologies — cloud, mobile, IoT — and how these are “breaking” our internal business processes by fragmenting the channels and information sources. The result is information chaos, where information about a client lives in multiple places and often can’t be properly aggregated and contextualized, while still remaining secure. Our legacy systems, designed to be secure, were put in place before the devices that are causing security leaks were even invented; those older systems can’t even envision all the ways that information can leak out of an organization. Furthermore, the more consumer technologies advance, the further behind our IT people seem, making it more likely that business users will just go outside/around IT for what they need. New technologies need to be put in the context of our information management practices, and those practices adjusted to include the disruptors, rather than just ignore them: consider how to minimize risk in this information chaos state;  how to use information to engage and collaborate, rather than just shutting it away in a vault; how to automate processes that involve information that may not be stored in an ECM; and how to extract insights from this information.

A speaker from Fujitsu was up next, stating some interesting statistics on just how big the information chaos problem is:

  • 50% of business documents are still on paper; most businesses have many of their processes still reliant on paper.
  • Departmental CM systems have proliferated: 75% of organizations with a CM system have more than one, and 25% have more than four. SharePoint is like a virus among them, with an estimated 50% of organizations worldwide using SharePoint ostensibly for collaboration, but usually for ad hoc content management.
  • Legacy CM systems are themselves are a hidden source of costs, inefficiency and risk.

In other words, we have a lot of problems to tackle still: large organizations tend to have a lot of non-integrated content management systems; smaller organizations tend to have none at all.

We finished the first morning segment with an introduction from the event sponsors at small booths around the room:

An obvious omission (to me, anyway) was IBM/FileNet — not sure why they are not here as a sponsor considering that they have a sizable local contingent.

The rest of the morning was taken up with two sets of short vendor presentations, each followed by a Q&A session moderated by John Mancini: first Epson, K2 and EMC; then KnowledgeLake, HP Autonomy, Kodak alaris and OpenText. There were audience questions about information security and risk, collaboration/case management, ECM benefits and change management, auto-classification, SharePoint proliferation, cloud storage, managing content retention and disposal, and many other topics; lots of good discussions from the panelists. I was amazed (or maybe just sadly accepting) at the number of questions dealing with paper capture and disposal; I’ve been working in scanning/workflow/ECM/BPM since the late 80’s, and apparently there are still a lot of people and processes resistant to getting rid of paper. As a small business owner, I run a paperless office, and have spent a big chunk of my career helping much larger enterprises go paperless as part of streamlining their processes, so I know that this is not only possible, but has a lot of benefits. As one of the vendors pointed out, just do something, rather than sitting frozen, surrounded by ever-increasing piles of paper.

I skipped out at lunchtime and missed the closing keynote since it was the only bit remaining after the lunch break, although it looked like a lot of the customer attendees stayed around for the closing and the prize draws afterwards, plus to spend time chatting with the vendors.

Thanks to AIIM and the sponsors for today’s seminar; the presentations were a bit too sales-y for me but some good nuggets of information. There’s still one remaining in Chicago and one in Minneapolis coming up next week if you want to sign up.

The Case For Smarter Process At IBMImpact 2014

At analyst events, I tend to not blog every presentation; rather, I listen, absorb and take some time to reflect on the themes. Since I spent the first part of last week at the analyst event at IBM Impact, then the second half across the country at Appian World, I waited until I had to pull all the threads together here. IBM keeps the analysts busy at Impact, although I did get to the general session and a couple of keynotes, which were useful to provide context for the announcements that they made in pre-conference briefings and the analyst event itself.

A key theme at Impact this year was that of “composable business” (I have to check carefully every time I type that to make sure I don’t write “compostable business”, but someone did point out that it *is* about reuse…). I’m not sure that’s a very new concept: it seems to be about assembling the building blocks of business capabilities, processes and technologies in order to meet the current needs without completely retooling, which is sort of what we’ve all been saying that BPM, ODM and SOA can do for some years now.

Smarter Process is positioned as an enabler of composable business, and is IBM’s approach for “reinventing business operations” by enabling the development of customer-centric applications that push top-line growth, while still providing the efficiency and optimization table stakes. Supporting knowledge workers has become a big part of this, which leads to IBM’s biggest new feature in BPM: the inclusion of “basic” case management within BPM. The idea is that you will be able to support a broader range of work types on a single platform: pre-defined “structured” processes, structured processes with some ad hoc activities, ad hoc (case) work that can invoke structured process segments, and fully ad hoc work. I’ve been talking about this range of work types for quite a while, and how we need products that can range across them, because I see so few real-world processes that fit into the purely structured or the purely unstructured ends of the spectrum: almost everything lies somewhere in the middle, where there is a mix of both. In fact, what IBM is providing is “production case management”, where a designer (probably not technical, or not very technical) creates a case template that pre-defines all of the possible ad hoc activities and structured process fragments; the end user can choose which activities to run in which order, although some may be required or have dependencies. This isn’t the “adaptive case management” extreme end of the spectrum, where the end user has complete control and can create their own activities on the fly, but PCM covers a huge range of use cases in business today. Bruce Silver

“But wait,”, you say, “IBM already has case management with IBM Case Manager. What’s the difference?” Well, IBM BPM (Lombardi heritage) provides full BPM capabilities including process analytics and governance, plus basic case capabilities, on the IBM BPM platform;  IBM Case Manager (FileNet heritage) provides full content and case capabilities including content analytics and governance, plus basic workflow capabilities, on the IBM ECM platform. Hmmm, sounds like something that Marketing would say. The Smarter Process portfolio graphic includes the three primary components of Operational Decision Management, Business Process Management and Case Management, but doesn’t actually specify which product provides which functionality, leaving it open for case management to come from either BPM or ICM. Are we finally seeing the beginning of the end of the split between process management in BPM and ICM? The answer to that is likely more political than technical – these products report up through different parts of IBM, turning the merging/refactoring of them into a turf war – and I don’t have a crystal ball, but I’m guessing that we’ll gradually see more case capabilities in BPM and a more complete integration with ECM, such that the current ICM capabilities become redundant, and IBM BPM will expand to manage the full spectrum of work types. The 1,000th cut may finally be approaching. Unfortunately for ICM users, there’s no tooling or migration path to move from ICM to BPM (presumably, no one is even talking about going the other way) since they are built on different infrastructure. There wasn’t really a big fuss made about this new functionality or how it might overlap with ICM about this outside the BPM analyst group; in fact, Bruce Silver quipped “IBM Merges Case into BPM but forgets to announce it”. Winking smile

The new case management functions are embedded within the BPM environment, and appear fairly well integrated: although a simple web-based case design tool is used instead of the BPM Eclipse authoring environment, the runtime appears within the BPM process portal. The case detail view shows the case data, case document and subfolders, running tasks, activities that can be started manually (including processes), and an overall status – similar enough to what you would see with any work item that it won’t be completely foreign, but with the information and controls required for case management. Under the covers, the ad hoc activities execute in the BPM (not ICM) process engine, and a copy of ECM is embedded within BPM to support the case folder and documents artifacts.

The design environment is pretty simple, and very similar to some parts of the ICM design environment: required and optional ad hoc activities are defined, and the start trigger (manual or automatically based on declarative logic or an event) of each activity is specified. Preconditions can be set, so that an activity can’t be started (or won’t automatically start) until certain conditions are met. If you need ad hoc activities in the context of a structured process, these can be defined in the usual BPM design environment – there’s no real magic about this, since ad hoc (that is, not connected by flow lines) activities are part of the BPMN standard and have been available for some time in IBM BPM. The case design environment is integrated with Process Designer and Process Center for repository and versioning, and case management is being sold as an add-on to IBM BPM Advanced.

Aside from the case management announcement, there are some new mobile capabilities in IBM BPM: the ability to design and playback responsive Coaches (UI) for multiple form factors, and pushing some services down to the browser. These will make the UI look better and work faster, so all good there. IBM also gave a shout out to BP3’s mobile portal product, Brazos, for developing iOS and Android apps for IBM BPM; depending on whether you want to go with responsive browser or native apps as a front-end for BPM, you’re covered.

They also announced some enhancements to Business Monitor: a more efficient, high-performance pub-sub style of event handling, and the ability to collect events from any source, although the integration into case management (either in BPM or ICM) at design time still seems a bit rudimentary. They’ve also upgraded to Cognos BI 10.2.1 as the underlying platform, which brings more powerful visualizations via the RAVE engine.  I have the impression that Business Monitor isn’t as popular as expected as a BPM add-on: possibly by the time that organizations get their processes up and running, they don’t have the time, energy or funds for a full-on monitoring and analytics solution. That’s too bad, since that can result in a lot of process improvement benefits; it might make sense to be bundling in some of this capability to at least give a teaser to BPM customers.

In BPM cloud news, there are some security enhancements to the Softlayer-based BPM implementations, including 2-factor authentication and SAML for identity management, plus new pricing at $199/user/month with concurrent user pricing scenarios for infrequent users. What was more interesting is what was not announced: the new Bluemix cloud development platform offers decision services, but no process services.

Blueworks Live seemed to have the fewest announcements, although it now has review and approval processes for models, which is a nice governance addition. IBM can also now provide Blueworks Live in a private cloud – still hosted but isolated as a single tenant – for those who are really paranoid about their process models.

BPM For Product Lifecycle Management At Johnson & Johnson

In this last breakout of Innovation World, simultaneous sessions from Johnson & Johnson and Johnson Controls were going on in adjacent rooms. I’m guessing that a few people might have ended up in the wrong session.

I was in the J&J session, where Pieter Boeykens and Sanjay Mandloi presented on web collaboration and process automation for global product development in the highly regulated health and pharmaceutical industry. They have a standardized set of processes for developing and launching products, with four different IT systems supporting the four parts of the PLM. A lot of this focuses on collecting documents from employees and suppliers all over the world, but there was no control over the process for doing this and the form of the information collected – they had five different processes for this in four regions. They rationalized this into a single standardized global process, modeled in webMethods BPM, then spent a significant amount of time on the human interaction at each step in the process: creating wireframes, then going through several version of the UI design in collaboration with the business users to ensure that it was intuitive and easy to use. They integrated BrainTribe for content management, which apparently handles the documents (the architecture diagram indicated that the actual documents are in Documentum) but also integrates structured content from other systems such as SAP.

In conjunction with this, they performed a webMethods upgrade from 8.2.x to 9 for their existing integration applications, migrating over their existing applications with little impact. Interestingly, this aspect generated far more questions from the audience than any of the functionality of the new BPM implementation, which gives you an idea of the business-technical mix in the audience. Smile

That’s it for Software AG’s Innovation World 2013. Next week, I’ll be in Vegas for TIBCO’s TUCON conference, where I’ll be on an analyst panel on Wednesday, then back to Vegas the following week for SAP TechEd (not next week, as I tweeted earlier) with a detour through Houston on the way home to speak at the APQC process conference. If you’re at any of those events, look me up and say hi.

Activiti Update 2013: New Functionality And New Partners

I had a briefing on the latest version of Alfresco’s Activiti BPM a couple of months back, but decided to wait until the news about their new partnersBP3 and Edorasware – was released before I posted. This strong showing of enterprise support partners is crucial for them following the defection of camunda from the Activiti fold, since many large enterprises won’t deploy an open source product without some level of support from the open source vendor directly or via their partner channel.

Alfresco’s interest in Activiti is as a part of their open source enterprise content management suite: they don’t offer Activiti as a standalone commercial open source product, only bundled within their ECM. Activiti exists as an Apache-licensed open source project with about 1/3 of its main developers – likely representing more than 1/3 of the actual development effort – being Alfresco employees, making Alfresco the main project sponsor. Obviously, Alfresco’s document-centric interests are going to be represented within the Activiti project, but that doesn’t make it unsuitable as a general purpose BPMS; rather, Alfresco makes use of the BPM platform functionality for the purpose of document flow and tasks, but doesn’t force content concepts into Activiti or require Alfresco in any way to use Activiti. Activiti is continuing to develop functionality that has nothing to do with ECM, such as integration with MuleESB.

Activiti was one of the first BPMS platforms to execute BPMN 2.0 natively, and provides full support for the standard. It’s not a “zero-code” approach, but intended as a developer tool for adding high-performance, small-footprint BPM functionality to applications. You can read more about full Activiti functionality on the main project site and some nuances of usage on the blog of core developer Joram Barrez; in this post, I just want to cover the new functionality that I saw in this briefing.

Activiti BPM 5.12 ad hoc task collaborationLike all of the other BPMS out there, Activiti is jumping on the ad hoc collaborative task bandwagon, allowing any user to create a task on the fly, add participants to the task and transfer ownership of the task to another participant. The task definition can include a due date and priority, and have subtasks and attached content. Events for the task are showing in an activity feed sidebar, including an audit trail of the actions such as adding people or content to the task, plus the ability to just post a comment directly into the activity feed. The Activiti Explorer UI shows tasks that you create in the My Tasks tab of the Tasks page, although they do not appear in the Inbox tab unless (I think) the task is actually assigned to you. If someone includes you as a participant (“involves” you) in a task, then it shows in the Involved tab. This is pretty basic case management functionality, but provides quite a bit of utility, at least in part because of the ability to post directly to the activity feed: instead of having to build data structures specific to the task, you can just post any information in the feed as a running comments section. Mostly unconstrained, but at least it’s in a collaborative environment.

Activiti BPM 5.12 table-driven process definitionThe other big new thing is a table-driven process definition as an alternative to the full BPMN modeler, providing a simpler modeling interface for business users to create models without having to know BPMN, or for fast process outlining. This allows you to create a process definition, then add any number of tasks, the order of which implies the sequence flow. Each task has a name, assignee, group (which I believe is a role rather than a direct assignment to a person) and description; you can also set the task to start concurrently with the previous task, which implies a parallel branch in the flow. Optionally, you can define the form that will be displayed for this task by adding a list of the properties to display, including name, type and whether each is mandatory; this causes an implicit definition of the process instance variables. The value of these properties can then be referenced in the description or other fields using a simple ${PropertyName} syntax. You can preview the BPMN diagram at any time, although you can’t edit in diagram mode. You can deploy and run the process in the Activiti Explorer environment; each task in the process will show up in the Queued tab of the Tasks page if not assigned, or in the Inbox tab if assigned to you. The same task interface as seen in the ad hoc task creation is shown at each step, with the addition of the properties fields if a form was defined for a task. The progress of the process instance can be viewed against the model diagram or in a tabular form. Indeed, for very simple processes without a lot of UI requirements, an entire process could be defined and deployed this way by a non-technical user within the Explorer. Typically, however, this will be used for business people to prototype a process or create a starting point; the model will then make a one-way trip into the Eclipse modeling environment (or, since it can be exported in BPMN, into any other BPMN-compliant tool) for the developers to complete the process application. Once the simple table-driven process is moved over to the Eclipse-based Activiti Modeler, it can be enhanced with BPMN attributes that can’t be represented in the table-driven definition, such as events and subprocesses.

There were a few other things, such as enhanced process definition and instance management functions, including the ability to suspend a process definition (and optionally, all instances based on that definition) either immediately or at a scheduled time in the future; some end-user reporting with configurable parameters; and integration of an SMS notification functionality that sent me a text telling me that my order for 2 iPads was shipped. Sadly, the iPads never arrived. Winking smile

We finished with a brief description of their roadmap for the future:

  • Hybrid workflow that allows on-premise and cloud (including instant deployment on CloudBees) for different tasks in same flow, solving the issue of exposing part of process to external participants without putting the entire process off premise.
  • Project KickStart, which builds on the table-driven process definition that I saw in the demo to provide better UI form display (making a real contender as a runtime environment, rather than just for prototyping) and the ability to make changes to the process definition on the fly.
  • Polyglot BPM, allowing Activiti to be called from other (non-Java) languages via an expanded REST API and language-specific libraries for Ruby, C#, Javascript and others.

It’s great to see Activiti continue to innovate after so much change (losing both the original product architect and their main partner) within a short period of time; it certainly speaks to their resiliency as an organization, as you would expect from a robust open source project.

I also talked with Scott Francis of BP3 about their new Activiti partnership; apparently the agreement was unrelated to the camunda departure, but definitely well-timed. I was curious about their decision to take on another BPM product, given their deep relationship with IBM (and formerly with Lombardi), but they see IBM BPM and Activiti as appealing to different markets due to organizational cultural choices. Certainly to begin with, most of their new Activiti customers will be existing Activiti customers looking for an enterprise support partner, just as many of their new IBM BPM customers are already IBM BPM customers; however, I’ve been in a couple of consulting engagements recently where organizations had both commercial and open source solutions under evaluation, so I’m anticipating a bit of channel conflict here. BP3 has no existing Activiti customers (or any other BPM other than IBM), and has no significant open source contribution experience, but plans to contribute to the Activiti open source community, possibly with hybrid/HTML mobile front-ends, REST APIs architecture and other areas where they have some expertise from building add-ons to IBM BPM. Interestingly, they do not plan to build/certify WAS support for Activiti; although they didn’t see this as a big market, I’m wondering whether this also just cuts a bit too close to the IBM relationship.

Aside from the obvious potential for awkwardness in their IBM relationship, I see a couple of challenges for BP3: first, getting the people with the right skills to work on the Activiti projects. Since the IBM BPM skills are pretty hard to come by, they won’t be redeploying those people, so presumably have to train up other team members or make some new hires. The other challenge is around production support, which is not something that BP3 does a lot of now: typically, IBM would be the main production support for any IBM BPM installation even if BP3 was involved, although BP3 would support their own custom code and may act as triage for IBM’s support. With Activiti, they will have to decide whether they will offer full production support (and if not them, then who?) or just provide developer support during business hours.

OpenText EIMDay Toronto, Customer Keynotes

Following the company/product keynotes, we heard from two OpenText customers.

First up was Tara Drover from Hatch Engineering, a Canadian engineering firm with 11,000 employees worldwide. They have OpenText Content Server on 10 corporate instances containing 32 million documents for more than 37,000 projects, almost half at their corporate headquarters in the Toronto area. They use it for project documentation, but also for a variety of other administrative and management documents. It appears that they have configured and customized Content Server, and built add-ons, to be the core of their corporate information store. They’ve been using Content Server since 2002 (v9.1), and have upgraded through v9.5 (including “de-customization”, a term and philosophy that I adore), v9.7.1 and v10. The latest upgrade, to CS10, is the one that she focused on in her presentation. Their drivers for the upgrade were to move to a 64-bit platform for scalability and performance reasons, to get off v9.7.1 before support ended, and to set the stage for some of the features in CS10: facets and columns, an improved search engine, and multilingual support. However, they wanted to keep the UI as similar as possible, providing more of a back-end upgrade as a platform for growth rather than a radical user experience change.

They started in March 2012 with strategy, change assessment and planning, then continued on to environmental assessment, development and testing, people change management and their first deployment in July 2012. Their readiness assessment identified that they first had to update their Windows Server and SQL Server instances (to 2008 — hardly cutting edge), and showed some of the changes to the integration points with other Hatch systems. As part of their development and testing, they developed an 80-page deployment guide, since this would have to roll out to all of the Content Server sites worldwide, including estimates of times required for the upgrade in order to avoid downtime during local business hours, and plans for using local staff for remote upgrades. During development and testing, they simultaneously ran the v9.7.1 production environment on the upgraded Windows Server platform, plus a CS10 development environment and a separate CS10 test/staging environment where the production processes were cloned and tested.

If you’re upgrading a single Content Server instance, you’re unlikely to go to this level of complexity in your upgrade plans and rollout, but for multiple sites across multiple countries (and languages), it’s a must. In spite of all the planning, they did have a few hiccups and some production performance issues, in part because they didn’t have a load testing tool. From their first rollout in Santiago, Chile in July 2012, followed by a few months of tuning and testing, they’re now rolling out about one site per month. They’re seeing improvements in the UI and search functions, and are ready to start thinking about how to use some of the new CS10 features.

They had a number of success factors that are independent of whatever product that you’re upgrading, such as clearly defined scope, issue management, and upgrading the platform without adding too many new user features all at once.

The second customer keynote was from Robin Thompson, CIO for the shared services sector of the Government of Ontario. They had some pretty serious information and records management issues, pretty much leaving the retention and disposition of information in the hands of individuals, with little sharing of information between ministries. To resolve this, they have developed a framework for information management over the next several years, targeted at improving efficiencies and improving services to constituents. Their guiding principles are that nformation needs to be protected and secure, managed, governed, accessible and relevant, and valued; in other words, the information needs to be managed as business records. Their roadmap identified an enterprise records and document management service as a necessary starting point, which they have deployed (based on OpenText) in the past year to the Social Services Ministries, with six more areas queued up and ready to implement. In addition to deploying in more ministries, they are also expanding functionality, bringing in email records management. to the Ministry of Finance later this year. This information management framework and vision is long overdue for the Ontario government, and hopefully will lead to better services for those of us who live here.

She shared a number of lessons that they learned along the way: the importance of change management and stakeholder communication; the time required for developing data architecture and taxonomy; the balance between overly-rigid standardization and too many customized instances; the need for external and internal resources to develop and maintain a records/document management practice; and the importance of governance. They’ve focused on an incremental approach, and have allowed the business leaders to pull the functionality rather than have IT push it into the business areas.

OpenText EIM Day Toronto, Company/Product Keynotes

I always try to drop in on vendor events that happen in my own backyard, so today I’m at OpenText’s EIM Day in Toronto. OpenText is a success story in the Canadian software space, focused on enterprise information management, which includes content and process management. They have grown significantly through acquisitions, acquiring (somewhat controversially) two different BPM vendors (Metastorm and Global 360) to add to their home-grown content management capabilities.

Following a welcome from Jim McIntyre, the regional VP of sales, we heard a keynote from Mark Barrenechea, CEO. Barrenechea was with SAP Oracle in the past, and obviously has continued to leverage those strong ties into the ERP market by integrating and partnering with SAP and other ERP vendors. He sees information-based strategies as the direction of business-technology transformation today, providing support for all of the unstructured information that lives alongside the structured information in ERP and other line of business systems. He outlined several transformations going on in the information enterprise: paper to digital; hierarchical to social; on premise to hybrid cloud; fragmented to managed, secured and governed; products to platforms; and ERP to EIM. He claimed that they will be able to replace multiple different products with a single platform from OpenText covering everything from capture to archive — capture, content management, process management, customer experience management (CEM) — although it appears that’s not yet released, and not clear if this will be a product branding exercise rather than a fully integrated platform.

This appeared to be a fairly conservative audience in terms of product adoption — I sat with someone who was just in the process of converting their LiveLink installation to Content Server, which I think is a bit overdue — so I’m not sure how well the message about their Tempo social collaboration platform went down, but OpenText will be pushing it later this year by using it for customer support and service interactions. What did go over well was Barrenechea’s scare tactic about Dropbox and Google Docs licensing — “did you know that they have the right to use your content for whatever purposes that they want?” — as a lead-in to the need for content security.

Barrenechea wrapped up with a product overview in their four main categories:

  • ECM, with Content Server, Tempo Box (an enterprise Dropbox-like product) and Archive (storage management)
  • CEM, with Tempo Social, DAM (digital asset management), WEM (web experience management) and CCM (customer communication management) making up the social suite
  • BPM, with Assure, MBPM and targeted apps making up their Smart Process Apps
  • iX (information exchange), with Secure iX, EDI and MFT (managed file transfer) providing secure transactions
  • DX (discovery), with InfoFusion and Semantic Navigation, indicating OpenText’s reentry into enterprise search; keep in mind that OpenText was a spin-off from a University of Waterloo project for indexing and searching the Oxford English Dictionary, making search part of their DNA

This still seems like a lot of products to me, many of which came through acquisitions hence may have quite different internal architecture. Although Barrenechea made claims that these are integrated, I did hear the qualifier “…on some level”. Hopefully they are integrated in more than his slide deck.

We had a deeper product view with Lynn Elwood, VP of product marketing, walking us through a (fictional) customer use case for a tablet manufacturer:

  • Creating and publishing product web pages using WEM (this functionality originated with the Vignette acquisition), including a review/approval cycle for the content before publication, plus cross-platform publication to update Facebook and Twitter with the newly published information, as well as mobile-optimized sites. This also gathers metrics and KPIs about the published information, including user actions, sentiment, ratings and comments.
  • Customer communications using StreamServe for customizing any customer communications, including adding customer-specific messages to invoices and letters.
  • Dynamic case management for help desk and product complaints/returns, which can include scanned documents with content captured automatically and added as case metadata. Mobile device support and Tempo Box allows a customer to take a photo of damaged goods and upload for the CSR to review.
  • Process analytics with ProVision (previously acquired by Metastorm, which was then acquired by OpenText) to model and simulate processes for improvement.
  • Records management within their Content Server product. This includes direct integration with Microsoft Outlook, so that emails can be manually dragged (or automatically moved) into folders that are managed by Content Server, hence can be part of a case and controlled by records management. There’s a lot of automated classification built in, so that content can be automatically found, classified and managed according to policies and usage.
  • Content storage management using their Archive product, which includes media staging and access control (including geographic constraints) based on policies.

A good overview of the product suite, but I’m still left with the feeling that this is a huge grab-bag of partially integrated components based on a variety of acquisitions over the years. They are definitely making progress in bringing them together, and the sort of use cases that Elwood showed us will help customers to understand the range of capabilities that OpenText can provide. As long as the products are individually capable and moving towards a common vision in terms of architecture, integration and user experience, there is an advantage to dealing with a single vendor for an array of related information management functionality: after all, that’s the same reason that many enterprises buy IBM products, in spite of an equally fragmented product acquisition and development strategy.

Smart Process Apps with Kofax and Forrester

Kofax sponsored a webinar this week (replay here) featuring Andy Bartels of Forrester Research speaking about Smart Process Applications (SPA): a term introduced by Forrester to describe collaborative, process-based packaged applications for human-centric work. In their terms: “a new generation of applications to help make human-centric, collaborative business activities be more effective”, with the goal to “help people be smarter in executing critical business activities”. You can check out their report on this from last year; the name is still struggling to gain acceptance, but vendors such as Kofax and OpenText (for whom I did a webinar and white paper on this topic last month) are helping to push it as a slice of the ECM/BPM/CM market where they have product offerings [by CM, I mean case management, including advanced CM (ACM), adaptive CM (also ACM), production CM (PCM) and dynamic CM (DCM), the latter term preferred by Forrester].

Forrester makes the distinction between transactional process apps and SPAs: transactional process apps tend to have standardized processes and little collaboration, whereas SPAs have a greater degree of collaboration as well as decision-making by the participants. If that was all, then this would just fall into the case management category – probably production case management – but an important focus of SPAs is that they are packaged applications for a specific activity: contract lifecycle management, customer support, procurement and the like. Bartels described them as filling in the gaps between the transactional apps, rather than using email and spreadsheets to bridge those gaps. He kept referring to these apps as “making people smarter”, which I think is a slightly awkward way of saying that they provide informational context for human decision-making, providing the right information to people at the right time to do their work.

He pointed out that BPM/DCM platforms provide an application development environment for companies to build their own SPAs, and that companies can then keep that app to themselves as a competitive differentiator, give it back to the vendor to incorporate into the base product, or sell it themselves (possibly in conjunction with the vendor). I think that a lot of these apps will come from the vendors directly, possibly via code developed for customer projects.

Kofax Smart Process AppsMartyn Christian of Kofax took the second part of the webinar to talk about Kofax solutions that fit into the Smart Process Apps envelope: capture of content as it moves from systems to engagement to systems of record is definitely their sweet spot. He overlaid their technology portfolio on Forrester’s “jigsaw” graphic to show that they offer something in all five pieces, although they are really pushing a platform for building SPAs, not the fully packaged SPAs that we’re seeing from some other vendors that are starting from a more comprehensive platform. That being said, Kofax is offering a customer onboarding SPA for capturing information at the point of origination, automating NIGO (not in good order) resolution and integrating with line of business and ECM systems; this sort of capture-focused SPA, or what they call “First Mile Solutions” is what we’re likely to see from Kofax in the future, especially as they continue to integrate the functionality of the Singularity (BPM/CM) and Altasoft (BI/analytics) acquisitions.

Forrester has a brand new Wave for SPAs; you can get this from the Kofax site here (registration required), plus a copy of a Forrester market analysis of multichannel capture, BPM and SPA, commissioned by Kofax. I’m sure that many of the other vendors in the Wave will have the report available as well, and it’s an interesting group of vendors: some horizontal BPM/ECM vendors, Salesforce, and a supply chain software vendor. This category is still such a mixed bag, and it does have the feeling of Forrester running a clustering algorithm on characteristics of existing solutions to see what they had in common, then “creating” the SPA category to describe them. Whether this is a true market category or just a speed bump on the way to a new age of applications and their development platforms remains to be seen.

Stick A (Open Source) Fork In It: camunda BPM Splits From Activiti

At the end of 2012, I had a few hints that things at Alfresco’s Activiti BPM group was undergoing some amount of transition: Tom Baeyens, the original architect and developer of Activiti (now CEO of the Effektif cloud BPM startup announced last week), was no longer leading the Activiti project and had decided to leave Alfresco after less than three years; and camunda, one of the biggest Activiti contributors (besides Alfresco) as well as a major implementation consulting partner, was making noises that Activiti might be too tightly tied to Alfresco’s requirements for document-centric workflow rather than the more general BPM platform that Activiti started as. I’m not in a position to judge how Alfresco was controlling the direction and release cycle of Activiti, who was making the biggest contribution to the open source efforts, or what was said behind closed doors, but obviously things reached a breaking point, and this week camunda announced that they are forking a new open source project from Activiti, to be known as camunda BPM.

This is big news in the world of open source BPM. There are a few players already – Activiti, BonitaSoft, jBPM and Processmaker, to name a few – and it’s not clear that there’s enough demand for open source BPM software to warrant another entrant. Also, there has to be some hard feelings between the parties here, and this is a small community where you can’t really afford to make enemies, because you never know who you’re going to end up working with in years to come. This parting of the ways is described as “sad” by both camunda in their announcement post and by Joram Barrez (current Activiti lead core developer) in his post, and puts Activiti and camunda in direct competition for both existing Activiti users and future business. Signavio, whose process modeler is deeply integrated with camunda BPM, issued a press release stating that the camunda BPM fork will be good for Signavio customers, and including a nice quote from Tom Baeyens; keep in mind that Signavio just provided the funding for Baeyens’ new startup. It’s like the Peyton Place of BPM.

Leaving the personal (and personnel) aspects aside, camunda BPM is offering some significant additional capabilities beyond what is available in Activiti, mostly through open-sourcing their previously proprietary Activiti add-ons. I had a briefing a couple of weeks ago with Jakob Freund, camunda’s CEO, to get caught up on what they’re doing. camunda is about 20 people now, founded 4-1/2 years ago and completely self-funded. That makes them a bit small for launching an enterprise software product – including the implementation and support aspects – but also not driven to unreasonable growth since they have no external investors to please. Having once grown a consulting company to about twice that size without external funding, I can understand the advantages of maintaining the organic growth: control to pick the projects and products that you want to build, and to hand-pick a great team.

camunda BPM, as with Activiti (and jBPM, for that matter) are not claiming to be zero-code BPM suites – some would argue that even those claiming to be, aren’t – but are BPM engines and capabilities intended to be embedded within line-of-business enterprise applications. They see the zero-coding market as being general tooling for non-strategic processes, and likely served equally well or better by outsourcing or cloud solutions (Effektif, anyone?); instead, camunda targets situations where IT is a competitive differentiator, and BPM is just part of the functionality within a larger application. That doesn’t mean that there’s nothing for the non-technical business analyst here: BPMN is used as a bridge for business-IT alignment, and camunda is bringing their previously proprietary BPMN round-tripping capabilities into the new open source project. Their BPMN plugin for Eclipse provides an easy-to-use modeler for business analysts, or round-tripping with Signavio, Adonis and other modeling tools; camunda blogged back in June 2012 about how to integrate several different BPMN modelers with camunda BPM, although they have a definite preference for Signavio.

camunda BPM is a complete open source BPM stack under an Apache License (except for Eclipse, the framework for the designer/developer UI, which uses the Eclipse Public License). The Community (open source) edition will always be the most up-to-date edition – note that some commercial open source vendors relegate their community edition to being a version behind the commercial edition in order to drive revenue – with the Enterprise (commercial) edition lagging slightly to undergo further testing and integrations. The only capabilities available exclusively in the Enterprise edition are WebSphere Application Server (WAS) integration and Cockpit Pro, a monitoring/administration tool, although there is a Cockpit Light capability in the Community edition. You can see a Community-Enterprise feature comparison here, and a more complete list here. Unless you’re tied to WAS from the start, or need quite a bit of support, the Community edition is likely enough to get you up and running initially, allowing for an easier transition from open source to commercial.

However, the question is not really whether camunda has some great contributions to make to the Activiti code base (they do), but whether they can sustain and build an open source fork of Activiti. They have some good people internally to provide vision – Daniel Meyer for the core process engine architecture, Bernd Rücker for a technical consulting/product management view, Jakob Freund for the business aspects of BPM – and a development team experienced with the Activiti and camunda code bases. They have showed significant leadership in the Activiti open source community and development, so are likely capable of running a camunda BPM open source community, but need to make sure that they dedicate enough resource to it to keep it vital. There is a German camunda community already, but that’s not the same as an open source community, and also is only in German, so they have some work to do there.

And then there’s the existing Activiti and camunda users. Existing camunda customers probably won’t be freaked out about the fork since the contributions important to them were being made by camunda anyway, but existing Activiti users (and prospects) aren’t just going to fall into camunda’s lap: they might be weighing the additional functionality against the bigger company, stable brand and existing community behind Activiti. Given some of the new UI features being rolled into Activiti from the Alfresco team, it’s fair to say that Alfresco will continue to innovate Activiti, and attempt to maintain their solid standing in the open source BPM market. There’s likely a small window for existing Acitiviti users to shift to camunda BPM if they want to: right now, the engine is identical and the migration will be trivial, but I expect that within six months, both sides will make enough changes to their respective projects that it will become a more significant effort. In other words, if you’re on Activiti or camunda now and are thinking of switching, do it now.

camunda could be ruffling a few feathers by declaring an open source fork rather than just rolling their proprietary offerings into the Activiti project; they might have been able to become a stronger influencer within the project by doing that, counteracting any (perceived) document-centric influence from Alfresco. Again, I’m not internal to either of the companies nor part of the Activiti open source community, so that’s just speculation.

Meanwhile, Alfresco remains officially silent on the whole business. Given that they had advance warning about this, that’s a pretty serious PR mistake.

IBMConnect (Lotusphere) 2013 Highlights: Product Updates, Smarter Workforce and Smarter Commerce

A couple of weeks ago, IBM had two analyst calls about the announcements this week at IBM Connect 2013; since I’m not at the conference, I wrote most of this at that time but only published today due to embargo restrictions. It’s the 20th anniversary of Lotusphere, although the conference is no longer branded as Lotusphere since the “smarter workforce” and “smarter commerce” streams are beyond just products with a Lotus heritage or brand.

The first briefing featured Jeff Schick, who heads up social software at IBM. He discussed new software and cloud services to put social business capabilities in the hands of C-level executives in HR and marketing, covering the dual goals of managing corporate intranets and talent, and managing external marketing campaigns. The catchphrases are “Activate the Workforce” and “Delight Customers”, enabled by IBM social business solutions for Smarter Workforce and Smarter Commerce, built on the social integration capabilities of IBM WebSphere Portal.

Specific product releases coming up in the next several weeks:

  • IBM Connections v4.5, with FileNet ECM now available as a native service: documents and their processes (processes within FileNet, I assume, not within IBM BPM) can be integrated into a Connections community, exposing FileNet functionality such as metadata and foldering through Connections, and providing fully integrated social capabilities such as tagging, commenting and liking, making content a first-class social citizen. This is hot. It will not include records management or Case Manager: it appears that these functions would be available on the FileNet side, but not exposed (at this time) through Connections. Quickr customers are being offered a migration path to IBM Connections Content Manager, which is a bundled FileNet repository that can be upgraded to the full ECM suite if you wanted to use it outside the Connections context. Connections can also integrate with SharePoint and Outlook, so is an option even if you’re a Microsoft customer in those areas.
  • IBM Notes 9 Social Edition, competing against Outlook 2013 with social-enabled email, activity Streams and other social capabilities.
  • IBM Docs for web-based collaboration, now available on-premise as well as in the cloud. This competes against Office 365 and Google Docs, but offers better collaboration than O365 (which requires passing control of a document between collaborators) and better rendering/conversion of Office documents than GDocs. IBM Docs is integrated with Connections for social features and sharing, in the same sort of way as Content Manager.
  • IBM Sametime replaces their existing meeting service in the cloud, including iOS and Android support. It uses the Polycom framework for video and audio support.
  • Deployment of all of this can be public cloud, private cloud, on-premise (not really sure of the distinction there) or a hybrid of these. Their SmartCloud for Social Business provides for the cloud deployment and adds wiki, blogs and other social authoring functionality. SmartCloud has Safe Harbor certification, making it a bit mire immune to government snooping, and can be private-labeled, with two telelcom companies already using this to provide these capabilities to their customers.

Everything is focused on mobile: mobile meetings, chat, Connections including Content Manager access, Docs and more.

Jonathan Ferrar, who heads up strategy for the Smarter Workforce business area, gave us an update on what they’re providing to support attracting, empowering and motivating employees. They have just completed their acquisition of Kenexa, and offer a portfolio of HR and workforce management products that includes behavioral sciences plus the entire platform for social business that Schick talked about, including analytics, collaboration and content management.

There are three main functional areas related to workforce management: attract (including recruitment, hiring, onboarding), empower (including learning and intranet content such as benefits and procedures), and motivate (including surveys, assessments and talent management). An integrated employee and HR portal uses existing IBM portal technology to expose Kennexa functionality and social features. There are also workforce analytics to monitor, provide insight and predict based on demographic, qualitative and social data, using both Cognos for dashboards and SPSS for analysis. There’s also some features related to outsourcing but not a lot of details; I was left with the impression that this was a strong capability of Kennexa prior to the acquisition.

I don’t know a lot about HR systems, although I’m seeing a huge potential to integrate this with operational systems such as BPM to drive analytics from the operational systems to the HR systems (e.g., employee performance measures), and even some from HR to the operational systems (e.g., learning management to push training to people at the point in their work when they need the training).

In the second briefing, we heard from Larry Bowden, VP of Web Experience software at IBM, covering the website building and user experience sides of Smarter Commerce and Social Business. He started out the the same “smarter workforce/exceptional customer experience” catchphrases as we heard on the earlier call, then went on to highlight some of their customers recognized for exceptional web experience awards in 2012. Web experience includes the smarter workforce (employee engagement, workplace social portal) and smarter commerce (web presence and brand marketing, buy, sell, market) areas, but also can include direct business uses (e.g., online banking, claims), engaging a broad variety of constituents (e.g., e-government), and customer self-service. The core of the IBM customer experience suite, however, is on the buy, market, sell  and service capabilities under their Smarter Commerce umbrella. They are working at putting the web marketing/commerce capabilities directly into the hands of business users (although if this is anything similar to how most vendors put BPMS capabilities directly into the hands of business users, I wouldn’t be too worried if I were a web developer), including both web content management/analytics and campaign management.

The Smarter Workforce and Smarter Commerce solutions are built on the IBM Social Business Platform, as we heard from Schick earlier, which includes WebSphere Portal, Web Content Manager, Connections, Notes & Domino Social Edition, Sametime, Social Analytics Suite, ECM, Web Experience Factory and Forms. That’s nine products just in the platform, then the Customer Experience Suite and Employee Experience Suite solutions built on top of that. Whew. There are other products that come in at the higher level, such as Worklight for mobile enablement.

There’s been a refresh on all of their web experience capabilities, resulting in a new IBM Web Experience “Next”, providing for faster content creation, social content rendering and multi-channel publishing. This is not so much a product as the list of everything across their product base that is being updated, and a more consistent user interface.

There’s a new digital asset management system for rich media management (part of a WCM Rich Media Edition?), although that’s currently in tech preview rather than released.

They’ve also done some PureSystems updates that make it faster to deploy and optimized complex configurations of the multiple IBM products required to support these capabilities – arguably, they should have spent some time on refactoring and reducing the number of products, rather than working out how to make bigger and better hardware to support these patterns.

As always after an IBM briefing, I’m left with a sense of almost overwhelming complexity in the number — and possible combinations — of products that make up these integrated solutions. Powerful: yes. But expect some rough edges in the integration.

Going Paperless On A Small Scale

Earlier this week, I linked to the Paperless 2013 website, a vendor-sponsored initiative that encourages businesses to cut paper, ostensibly for environmental reasons. The products featured by the sponsor vendors – Google Drive, HelloFax, Manilla, HelloSign, Expensify, Xero and Fujitsu ScanSnap – can certainly assist with this, although I run a completely paperless office using only one of those (Google Drive), and that one only in a secondary role. The interesting part was a conversation that ensued with another small business owner, although she was primarily interested in going paperless with personal documents (which I have also done), which made me realize that most small businesses are a bit clueless about how to go about this in a secure and legal fashion. I’ve been involved in large-scale document scanning projects since the 1980s, and I’ve gathered a lot of ideas about how to do this on a scale suitable for organizations of any size, so I thought that I’d lay out a plan suitable for small businesses.

Keep in mind that although I run a single person business, it’s incorporated, so I have the same paperwork requirements as any other private company: invoicing, payroll, government filings, income tax and all. I also do some amount of document collaboration with other small businesses, as well as for some non-profits with which I’m involved.

Here’s how I keep paperless:

  1. If I receive a document in electronic form, I leave it in electronic form unless I absolutely need to print it.
  2. If I generate a document, I leave it in electronic form unless I need to physically sign it (such as a contract) or take it to a client meeting (since many of my clients have not embraced the paperless way). This is not just Microsoft Office documents, but any document including things such as invoices, which I generate from my accounting software (QuickBooks) directly as a PDF and email to clients: I keep a copy of the PDF invoice, but it is never in paper form in my office. Services such as Freshbooks pride themselves on offering electronic invoicing, but you don’t need to switch if you’re happy with what you have, just install a good PDF generator and send it via email.
  3. If something is in paper form but I can get the electronic version instead, I do. Although my bank doesn’t provide electronic bank statements for commercial accounts, many other banks and service providers do. Most of my monthly expenses receipts, including travel and telecommunications, arrive in PDF, since most airlines, hotels and car rentals will email a receipt to you if you ask. My most common question at a client site when they hand me a huge printed document or presentation is “can I get that in electronic form”?”
  4. As a last resort, if I receive something in paper form (or have to print it in order to sign it), I scan it and shred the paper as soon as possible. This is the crux of most document imaging projects, but in reality is a fairly minor part these days if you do most of your communication electronically and can keep paper out of the mix altogether. Yes, it’s legal (more on that below). Since my volume is very low, I use an inexpensive Epson scanner that I picked up at Costco, and the software that came with it. That’s fine for a few pages a day, but anything more than 10 pages at a time gets tedious because it doesn’t have a sheet feeder. I would highly recommend a sheet feeder if you have a backlog of paper to convert, or if you regularly receive large paper documents. For smaller receipts when I’m travelling, I snap a photo with my iPhone, back it up to the cloud, then destroy the paper document.
  5. I use automated backup to replicate everything offsite. This eliminates the risk of losing documents, and allows me to access documents from my netbook when I’m travelling.
  6. I use online backup/sync services for shared content management when I collaborate on a project with other small firms and independents. Even if I were working with people in the same office, I would use the same methods since there’s no need to own your own servers.
  7. I manually maintain retention policies on the electronic documents, and delete them appropriately. In Canada, that means I need to keep all corporate and tax-related documents for six years past the end of the fiscal year: I just deleted my 2006 files and shredded the paper files, since that was the last year that I kept any paper records. For any files with a retention policy, I keep them in dated folders so that I can quickly purge them without having to search through files; this means a bit of electronic reorganization at the year end, but it takes only a few minutes.

The result: I have no paper files in my office, except for a small pile in my in-tray waiting to be scanned. No filing cabinets, no boxes of documents in storage. As an added bonus, I have offsite backup, which most people with paper files don’t.

Quelling the nay-sayers:

  • “I don’t like to read on a screen”. Get a bigger/better screen, or dual monitors, and a tablet for taking it with you. Cheaper in the long run.
  • “It’s not secure”. Back everything up offsite, not just locally, in case of a physical disaster (fire/flood/theft). I use Jungle Disk (a division of RackSpace), which encrypts my data on the desktop, then uploads it to an encrypted Amazon S3 bucket. I hold the key, not them, so they can’t decrypt my data. My backup runs automatically, so I don’t need to do anything to make this happen.
  • “It’s too hard to create electronic documents”. Get a good PDF printer/document assembly application. I use CutePDF Pro, which allows me not only to generate PDFs from any application that can print, but also to assemble multiple PDFs into a single document, rearrange pages and other functions. This is useful when I need to append a timesheet to an invoice before sending to a client, or to concatenate all of my expense receipts to attach to a monthly expense report.
  • “I can find things easier in my filing system”. Easier than searching through full-text documents? I don’t think so, unless you have a really trivial number of files. Learn how to use search capabilities of your desktop environment (built into Windows, for example), install a third-party search utility, or (if your company is large enough) use a shared content management system.
  • “I need to keep these paper documents for legal/regulatory reasons”. Probably not. Most government taxation bodies have long accepted digital copies (scans of paper, or original digital documentation such as an invoice received as a PDF) in place of paper – what they refer to as “electronic record keeping”. You can see the Canada Revenue Agency’s take on this at http://www.cra-arc.gc.ca/tx/bsnss/tpcs/kprc/menu-eng.html, and similar policies exist for the IRS and other agencies. The Canada Labour Code has similar requirements for human resources records. You may need to research for your type of documents in your jurisdiction, but electronic record-keeping is most likely allowed.

If you’re starting from ground zero of a paper explosion, this might seem a bit daunting. Keep in mind that you can do this on a day-forward basis, since many of your old paper files can be shredded as they pass their 6th birthday: just go paperless starting today (or from the beginning of your fiscal year) and let the old paper cycle out over time. If you really love it and want to get ambitious, you can start doing some back scanning, but it may not be worth it. When I started in 2007, I was already keeping everything electronically that originated that way, but added in scanning of expense receipts (my biggest single paper volume) and government documents, which was not a big change. I still didn’t start scanning contracts for another few years, since they’re big and I don’t have a sheet feeder, but eventually went back and scanned all of the old ones just to clean out the last of the paper files.

A lot of these ideas, of course, are not limited to small business, but form the core of any ECM initiative. Things get more complex when you add in automated business processes to move those documents around between people, but the basic concepts, motivations and nay-saying are the same.