The Wayback Machine - https://web.archive.org/web/20180203224238/http://devops.sys-con.com:80/node/4223388

Welcome!

@DevOpsSummit Authors: Otto Berkes, Yeshim Deniz, Elizabeth White, Simon Hill, Dalibor Siroky

Related Topics: @CloudExpo, Artificial Intelligence, @DXWorldExpo, @DevOpsSummit

@CloudExpo: Article

In Search of the Elusive ‘Citizen Integrator’ | @CloudExpo #DigitalTransformation

The business context for the task at hand isn’t integration – the context is the desired insight into the business.

The rise of the market for No-Code platforms and tools has given rise to a burgeoning population of ‘citizen developers’ – non-technical business personnel who can use these platforms to build an increasingly powerful set of business applications without writing a line of code.

As this market matures, different platforms focus on different challenges. As a result, a wider range of ‘citizen’ roles also evolve, such as citizen process creators and citizen data analysts.

High on this list: the new role of citizen integrator.

A citizen integrator is a non-technical business user who uses a No-Code integration tool to perform either application integration or data integration tasks – as well as tasks that combine these two integration modes.

Integration has always been a difficult technical task that has heretofore required the expertise of dedicated IT professionals. It is unsurprising, therefore, that there are Low-Code tools aplenty intended to simplify and streamline the work of such professionals.

The purpose of No-Code tools for the citizen integrator, in contrast, is to shift the responsibility of integration to the business. The promise is to lighten the burden on IT while giving lines of business greater flexibility and, in the end, improved customer centricity.

At least, that’s what the No-Code integration tool vendors hope. Just one problem: there’s no such thing as a citizen integrator.

Is ‘Making Integration Easy for the Business’ What We Really Want?

Any enterprise integration professional will tell you: integration is hard. In fact, it’s always been difficult, in spite of the fact that over the years, professional integration tools have become easier to use. Most of these tools now fall under the banner of Low-Code.

Yet, while today’s techie-focused integration tooling has helped simplify integration somewhat, it remains a complex, often costly challenge.

To understand why integration has such a high degree of difficulty, I dug up the following diagram from Enterprise Integration Patterns, the seminal 2004 book by Gregor Hohpe and Bobby Wolf.

Enterprise Integration Patterns (click here for a hyperlinked version)

At the time Hohpe and Wolf documented 64 distinct integration patterns, and in the 14 years since publication, this number has actually gone up. After all, we must now add cloud and container-specific patterns to the mix.

It’s no wonder, therefore, that most of today’s enterprise integration tools require a high level of technical expertise, even as their user interfaces have matured.

The bottom line: to deliver the power and flexibility of enterprise-class integration, an expert must understand how and when to apply the dozens of integration patterns in the diagram, regardless of the ease of use of the tooling at their disposal.

At the opposite extreme from such powerful, Low-Code tools for integration professionals are the No-Code tools for citizen integrators. These tools eschew all but the most basic of integration patterns and leverage pre-built integrations whenever possible.

If you’re connecting two popular apps with well-understood, stable APIs, such citizen integration is typically straightforward. The question, of course, is just how powerful these tools are for the more complicated integration scenarios commonplace in enterprise environments.

How sophisticated can the integrations amenable to the citizen integrator be, given the fundamental complexity of enterprise integration generally?

Never the Twain Shall Meet

We thus have two classes of integration technologies: powerful Low-Code tools for professional integrators, and easy-to-use No-Code tools for citizen integrators.

The key question: will we ever get power and non-technical ease-of-use in the same platform, thus opening up the full breadth of enterprise integration to citizen integrators?

After all, wouldn’t a single integration platform powerful enough to handle the complexities of enterprise integration but simple enough for non-techies to use be the true killer app of integration?

Perhaps. To be sure, the vendors in each of these market segments are driving innovation in predictable ways: the professional tools are becoming easier to use, incorporating visual drag-and-drop functionality more familiar to Low-Code/No-Code platforms, thus becoming fully Low-Code in their own right.

Correspondingly, the vendors of No-Code citizen integrator tools are adding increasingly powerful capabilities, in the hopes that they can take market share away from the first segment.

But the gap between these two extremes is still wider than we’d like, and no fancy drag-and-drop GUI is going to close it, because the gap is not in the tooling. It’s in the necessary expertise.

The leap from simple integration scenarios to the ins and outs of the proper application of the patterns above is just too great – unless we change the way we think about integration.

Rethinking the Context for Citizen Integration

There are plenty of vendors of Low-Code/No-Code integration tools who are looking at the diagram above and thinking about how they can sufficiently abstract all those integration patterns so that a citizen integrator doesn’t have to worry about them.

Their presumption is that citizen integrators want to be able to connect A to B simply and without any technical expertise, for any value of A or B relevant to the enterprise.

However, this line of reasoning is incorrect. In reality, there is no reason why a business person would want to become a ‘citizen integrator.’ And there likely never will be.

I’m not trying to say that there are no business users performing integration tasks. Examples of such activities are increasingly common. However, you’re not likely to go into a business meeting and have a discussion about connecting A to B.

Business users may want insights into their business, or smoothly running processes, or lowered business risk, or any number of other business priorities, but connecting A to B isn’t on the list. That’s just plumbing.

The bottom line: integration is a means to a business end, but the business doesn’t really care about integration, as long as it’s working properly. After all, you don’t think about the water pipes when you brush your teeth – unless there’s a problem, and then you call a plumber.

Here’s the disconnect: as vendors think about what they might want a citizen integrator to do, they take plumbing tasks and simplify them. After all, there are plenty of situations where business users might want a hand in building business applications. Doesn’t the same principle apply to integration as well?

Absolutely not. Applying Low-Code/No-Code principles to integration is not analogous to applying them to application creation, because in the digital era, applications are business concerns. Integration, however, is not – unless it’s broken, and then business users want to call a plumber.

The Intellyx Take

After interacting with integration professionals as well as citizen developers for many years, I’ve yet to run into anybody who identifies themselves as a citizen integrator. My theory: nobody calls themselves a citizen integrator.

Even though there are plenty of situations where a business user might want to perform some kind of integration, such a need won’t make the person a citizen integrator, because integration is never the business context for the task at hand.

Instead, here’s an example of how I envision a business user doing the work of what we might have wanted to call ‘citizen integration’ in the not-so-distant future:

The business person asks, “Siri, of our most profitable customers, which demographic tweets most favorably about our new product line?”

The query above instructs an AI-based agent to bring together customer data (perhaps from Salesforce), financial data (maybe from SAP), and data from Twitter, perform a complex data join, and then place the result into the context of the company’s product strategy and display the results.

The person making such a request will not be thinking of themselves as a citizen integrator, because the business context for the task at hand isn’t integration – the context in this case is the desired insight into the business.

The rest of the integration story? Nothing but plumbing.

If you call yourself a citizen integrator, then we want to hear from you! Please drop us a line. Copyright © Intellyx LLC. Intellyx publishes the Agile Digital Transformation Roadmap poster, advises companies on their digital transformation initiatives, and helps vendors communicate their agility stories. As of the time of writing, none of the organizations mentioned in this article are Intellyx customers.

 

More Stories By Jason Bloomberg

Jason Bloomberg is the leading expert on architecting agility for the enterprise. As president of Intellyx, Mr. Bloomberg brings his years of thought leadership in the areas of Cloud Computing, Enterprise Architecture, and Service-Oriented Architecture to a global clientele of business executives, architects, software vendors, and Cloud service providers looking to achieve technology-enabled business agility across their organizations and for their customers. His latest book, The Agile Architecture Revolution (John Wiley & Sons, 2013), sets the stage for Mr. Bloomberg’s groundbreaking Agile Architecture vision.

Mr. Bloomberg is perhaps best known for his twelve years at ZapThink, where he created and delivered the Licensed ZapThink Architect (LZA) SOA course and associated credential, certifying over 1,700 professionals worldwide. He is one of the original Managing Partners of ZapThink LLC, the leading SOA advisory and analysis firm, which was acquired by Dovel Technologies in 2011. He now runs the successor to the LZA program, the Bloomberg Agile Architecture Course, around the world.

Mr. Bloomberg is a frequent conference speaker and prolific writer. He has published over 500 articles, spoken at over 300 conferences, Webinars, and other events, and has been quoted in the press over 1,400 times as the leading expert on agile approaches to architecture in the enterprise.

Mr. Bloomberg’s previous book, Service Orient or Be Doomed! How Service Orientation Will Change Your Business (John Wiley & Sons, 2006, coauthored with Ron Schmelzer), is recognized as the leading business book on Service Orientation. He also co-authored the books XML and Web Services Unleashed (SAMS Publishing, 2002), and Web Page Scripting Techniques (Hayden Books, 1996).

Prior to ZapThink, Mr. Bloomberg built a diverse background in eBusiness technology management and industry analysis, including serving as a senior analyst in IDC’s eBusiness Advisory group, as well as holding eBusiness management positions at USWeb/CKS (later marchFIRST) and WaveBend Solutions (now Hitachi Consulting).

@DevOpsSummit Stories
DX World EXPO, LLC, a Lighthouse Point, Florida-based startup trade show producer and the creator of "DXWorldEXPO® - Digital Transformation Conference & Expo" has announced its executive management team. The team is headed by Levent Selamoglu, who has been named CEO. "Now is the time for a truly global DX event, to bring together the leading minds from the technology world in a conversation about Digital Transformation," he said in making the announcement.
DevOps promotes continuous improvement through a culture of collaboration. But in real terms, how do you: Integrate activities across diverse teams and services? Make objective decisions with system-wide visibility? Use feedback loops to enable learning and improvement? With technology insights and real-world examples, in his general session at @DevOpsSummit, at 21st Cloud Expo, Andi Mann, Chief Technology Advocate at Splunk, explored how leading organizations use data-driven DevOps to close their feedback loops to drive continuous improvement.
Cavirin Systems has just announced C2, a SaaS offering designed to bring continuous security assessment and remediation to hybrid environments, containers, and data centers. Cavirin C2 is deployed within Amazon Web Services (AWS) and features a flexible licensing model for easy scalability and clear pay-as-you-go pricing. Although native to AWS, it also supports assessment and remediation of virtual or container instances within Microsoft Azure, Google Cloud Platform (GCP), or on-premise. By drawing on a comprehensive library of curated industry guidelines, control frameworks, and best practices, Cavirin promises to keep a wary eye on your hybrid cloud security and help you harden it against real and potential threats.
How often is an environment unavailable due to factors within your project's control? How often is an environment unavailable due to external factors? Is the software and hardware in the environment up to date with the target production systems? How often do you have to resort to manual workarounds due to an environment? These are all questions that you should ask yourself if testing environments are consistently unavailable and affected by outages. Here are three key metrics that you can track that can help avoid costly downtime.
How is DevOps going within your organization? If you need some help measuring just how well it is going, we have prepared a list of some key DevOps metrics to track. These metrics can help you understand how your team is doing over time. The word DevOps means different things to different people. Some say it a culture and every vendor in the industry claims that their tools help with DevOps. Depending on how you define DevOps, some of these metrics may matter more or less to you and your team.
Enterprises are adopting Kubernetes to accelerate the development and the delivery of cloud-native applications. However, sharing a Kubernetes cluster between members of the same team can be challenging. And, sharing clusters across multiple teams is even harder. Kubernetes offers several constructs to help implement segmentation and isolation. However, these primitives can be complex to understand and apply. As a result, it’s becoming common for enterprises to end up with several clusters. This leads to a waste of cloud resources and increased operational overhead.
We all know that end users experience the Internet primarily with mobile devices. From an app development perspective, we know that successfully responding to the needs of mobile customers depends on rapid DevOps – failing fast, in short, until the right solution evolves in your customers' relationship to your business. Whether you’re decomposing an SOA monolith, or developing a new application cloud natively, it’s not a question of using microservices – not doing so will be a path to eventual business failure.
Let's do a visualization exercise. Imagine it's December 31, 2018, and you're ringing in the New Year with your friends and family. You think back on everything that you accomplished in the last year: your company's revenue is through the roof thanks to the success of your product, and you were promoted to Lead Developer. 2019 is poised to be an even bigger year for your company because you have the tools and insight to scale as quickly as demand requires. You're a happy human, and it's not just because of the bubbly in your glass. Now how does one turn this visualization into reality? You start by setting yourself up with the right technology to succeed. Behind every great cloud app is a fleet of powerful cloud monitoring tools that provide insight and direction for improving your product. This is the ticket for turning 2018 into the year of your dreams.
As many know, the first generation of Cloud Management Platform (CMP) solutions were designed for managing virtual infrastructure (IaaS) and traditional applications. But that's no longer enough to satisfy evolving and complex business requirements. In his session at 21st Cloud Expo, Scott Davis, Embotics CTO, explored how next-generation CMPs ensure organizations can manage cloud-native and microservice-based application architectures, while also facilitating agile DevOps methodology. He explained how automation, orchestration and governance are fundamental to managing today's hybrid cloud environments and are critical for digital businesses to deliver services faster, with better user experience and higher quality, all while saving money.
For many of us laboring in the fields of digital transformation, 2017 was a year of high-intensity work and high-reward achievement. So we’re looking forward to a little breather over the end-of-year holiday season. But we’re going to have to get right back on the Continuous Delivery bullet train in 2018. Markets move too fast and customer expectations elevate too precipitously for businesses to rest on their laurels. Here’s a DevOps “to-do list” for 2018 that should be priorities for anyone who wants to make sure their organization is running at the front of the digital pack through next year – and beyond.
In a world where the internet rules all, where 94% of business buyers conduct online research, and where e-commerce sales are poised to fall between $427 billion and $443 billion by the end of this year, we think it's safe to say that your website is a vital part of your business strategy. Whether you're a B2B company, a local business, or an e-commerce site, digital presence is key to maintain in your drive towards success. Digital Performance will take priority in 2018 for the following reasons: Competition is fierce - 79% of people who don't like what they find on one site will go back and search for another site.
SYS-CON Events announced today that Conference Guru has been named “Media Sponsor” of the 22nd International Cloud Expo, which will take place on June 5-7, 2018, at the Javits Center in New York, NY. A valuable conference experience generates new contacts, sales leads, potential strategic partners and potential investors; helps gather competitive intelligence and even provides inspiration for new products and services. Conference Guru works with conference organizers to pass great deals to great conferences, helping you discover new conferences and increase your return on investment.
DevOps is under attack because developers don’t want to mess with infrastructure. They will happily own their code into production, but want to use platforms instead of raw automation. That’s changing the landscape that we understand as DevOps with both architecture concepts (CloudNative) and process redefinition (SRE). Rob Hirschfeld’s recent work in Kubernetes operations has led to the conclusion that containers and related platforms have changed the way we should be thinking about DevOps and controlling infrastructure. The rise of Site Reliability Engineering (SRE) is part of that redefinition of operations vs development roles in organizations.
In his Opening Keynote at 21st Cloud Expo, John Considine, General Manager of IBM Cloud Infrastructure, led attendees through the exciting evolution of the cloud. He looked at this major disruption from the perspective of technology, business models, and what this means for enterprises of all sizes. John Considine is General Manager of Cloud Infrastructure Services at IBM. In that role he is responsible for leading IBM’s public cloud infrastructure including strategy, development, and offering management. To date, IBM has launched more than 50 cloud data centers that span the globe. He has been building advanced technology, delivering “as a service” solutions, and managing infrastructure services for the past 20 years.
The next XaaS is CICDaaS. Why? Because CICD saves developers a huge amount of time. CD is an especially great option for projects that require multiple and frequent contributions to be integrated. But… securing CICD best practices is an emerging, essential, yet little understood practice for DevOps teams and their Cloud Service Providers. The only way to get CICD to work in a highly secure environment takes collaboration, patience and persistence. Building CICD in the cloud requires rigorous architectural and coordination work to minimize the volatility of the cloud environment and leverage the security features of the cloud to the benefit of the CICD pipeline.
"ZeroStack is a startup in Silicon Valley. We're solving a very interesting problem around bringing public cloud convenience with private cloud control for enterprises and mid-size companies," explained Kamesh Pemmaraju, VP of Product Management at ZeroStack, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
"Infoblox does DNS, DHCP and IP address management for not only enterprise networks but cloud networks as well. Customers are looking for a single platform that can extend not only in their private enterprise environment but private cloud, public cloud, tracking all the IP space and everything that is going on in that environment," explained Steve Salo, Principal Systems Engineer at Infoblox, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
22nd International Cloud Expo, taking place June 5-7, 2018, at the Javits Center in New York City, NY, and co-located with the 1st DXWorld Expo will feature technical sessions from a rock star conference faculty and the leading industry players in the world. Cloud computing is now being embraced by a majority of enterprises of all sizes. Yesterday's debate about public vs. private has transformed into the reality of hybrid cloud: a recent survey shows that 74% of enterprises have a hybrid cloud strategy. Meanwhile, 94% of enterprises are using some form of XaaS – software, platform, and infrastructure as a service.
"CA has been doing a lot of things in the area of DevOps. Now we have a complete set of tool sets in order to enable customers to go all the way from planning to development to testing down to release into the operations," explained Aruna Ravichandran, Vice President of Global Marketing and Strategy at CA Technologies, in this SYS-CON.tv interview at DevOps Summit at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
Vulnerability management is vital for large companies that need to secure containers across thousands of hosts, but many struggle to understand how exposed they are when they discover a new high security vulnerability. In his session at 21st Cloud Expo, John Morello, CTO of Twistlock, addressed this pressing concern by introducing the concept of the “Vulnerability Risk Tree API,” which brings all the data together in a simple REST endpoint, allowing companies to easily grasp the severity of the vulnerability. He provided attendees with actionable advice related to understanding and acting on exposure due to new high severity vulnerabilities.
While some developers care passionately about how data centers and clouds are architected, for most, it is only the end result that matters. To the majority of companies, technology exists to solve a business problem, and only delivers value when it is solving that problem. 2017 brings the mainstream adoption of containers for production workloads. In his session at 21st Cloud Expo, Ben McCormack, VP of Operations at Evernote, discussed how data centers of the future will be managed, how the public cloud best suits your organization, and what the future holds for operations and infrastructure engineers in a post-container world. Is a serverless world inevitable?
SYS-CON Events announced today that CrowdReviews.com has been named “Media Sponsor” of SYS-CON's 22nd International Cloud Expo, which will take place on June 5–7, 2018, at the Javits Center in New York City, NY. CrowdReviews.com is a transparent online platform for determining which products and services are the best based on the opinion of the crowd. The crowd consists of Internet users that have experienced products and services first-hand and have an interest in letting other potential buyers learn their thoughts on their experience.
SYS-CON Events announced today that Telecom Reseller has been named “Media Sponsor” of SYS-CON's 22nd International Cloud Expo, which will take place on June 5-7, 2018, at the Javits Center in New York, NY. Telecom Reseller reports on Unified Communications, UCaaS, BPaaS for enterprise and SMBs. They report extensively on both customer premises based solutions such as IP-PBX as well as cloud based and hosted platforms.
A strange thing is happening along the way to the Internet of Things, namely far too many devices to work with and manage. It has become clear that we'll need much higher efficiency user experiences that can allow us to more easily and scalably work with the thousands of devices that will soon be in each of our lives. Enter the conversational interface revolution, combining bots we can literally talk with, gesture to, and even direct with our thoughts, with embedded artificial intelligence, which can process our conversational commands and orchestrate the outcomes we request across our personal and professional realm of connected devices.
SYS-CON Events announced today that Evatronix will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Evatronix SA offers comprehensive solutions in the design and implementation of electronic systems, in CAD / CAM deployment, and also is a designer and manufacturer of advanced 3D scanners for professional applications.