The Wayback Machine - https://web.archive.org/web/20170922055318/http://cloudcomputing.sys-con.com:80/node/4153376

Welcome!

@CloudExpo Authors: Yeshim Deniz, Liz McMillan, Jason Bloomberg, Elizabeth White, Larry Alton

Related Topics: Government Cloud, Microservices Expo, @CloudExpo, @BigDataExpo, @ThingsExpo, @DevOpsSummit

Government Cloud: Article

Data Lake and APIs | @CloudExpo #API #AI #ML #DX #CloudNative #DataLake

In this article we take you through the connected world of APIs and how you can reap maximum value

The Omnipresent World of APIs

These days, APIs have become an integral part of the digital transformation journey for all enterprises. Every digital innovation story is connected to APIs . But have you ever pondered over to know what are the source of these APIs?

Let me explain - APIs sources can be varied, internal or external, solving different purposes, but mostly categorized into the following two categories:

  • Data lakes is a term used to represent disconnected but relevant data that are used by various business units within an enterprise.  APIs are created as the easy access points for these siloed data lakes.
  • These days, organizations put in  conscious efforts in designing meaningful and pragmatic APIs for all the apps that get developed internally.  API-First or API Driven Development, where APIs are the first app artifacts to be generated, are adapted by enterprises as a part of their app development efforts.  In modern app development, as much as the apps share APIs generated internally, they also have to deal with a plethora of external APIs.  These external API are fed from SaaS services (eg. Google Calendar), API marketplaces (mashape) and integration clouds(e.g. Zapier).

With new technologies like IoT gaining traction,  there is going to be a proliferation of  APIs very soon.

API Management tools
How do enterprises manage these flurry of APIs that get generated?  How do they leverage these APIs to make them as easily accessible touch points for both internal and external stake holders, complete with security, subscription, plans, API rate limiting etc?  The answer is enterprises use API Management platforms/tools for the said purpose.

API management platforms help enterprises manage all aspects of APIs as defined above, ease the process of API access to all stakeholders and in general address all the management aspects of the entire API lifecycle.

Typical API sharing and consumption process
API Management tools typically take as input, all the APIs at its disposable and attaches multiple attributes like security, rate limiting, subscription plans etc. to each of those APIs.  These tools also provide something called as an API or a Developer portal.  This portal is a one point portal for searching and subscribing to APIs.

The typical process looks like as is shown in the following set of images for a fictitious company called Movi.  We have also used screens from WaveMaker low code platform for some illustrations.

This is a templatized approach followed by organizations who try to share their APIs with external (as well as internal) stakeholders.  But is this  process as shown in step 4, effective? Do organizations get the RoI from their investment on APIs quickly?

Loopholes with the current API management setup - Low RoI
The fact is that APIs, at the end of the day, are entities consumed inside an app.  With that in mind, consider some of the glaring issues with the current API consumption model, as listed below:

  • There exists competitive barriers for rapid proliferation of these APIs by enabling a much larger audience to build apps using those APIs.  Competitive barriers are because of  of a big super set of users with great ideas but no app coding skills than there are users with app coding skills.
  • Turnaround time from when APIs are published to when the API is really consumed in an app is longer due to the complexities surrounding the API documentation and consumption related technical intricacies.

What we need is to :

  • Remove the technical friction for anyone wanting to start building apps
  • Make it easier and faster for anyone to build apps to your APIs to increase the RoI faster

Let's fix it.  Remove the friction between app building and API access

The issues seem to have a very easy solution but probably needs the enterprise move up in the value chain of becoming a "Digital Enterprise".  The answer lies in adopting a low code development platform that can work out wonders in solving these issues.  Let me explain these in simple visual steps below:

1) Let's start with a simple change to the existing process as shown in figure-1, by adding an app creation step.  This will help in users to not just subscribe to an API plan but also start working on app instantly.  More details in the next steps will make this simple addition work wonders.

2) Start the developer portal registration exercise as always...

3) However during the registration process, we make sure to add an instant app creation step to facilitate users.  The button click will lead the users to a low code platform for visual app creation.  It's all in the mind!  This simple change in the registration workflow allows the user to instantly start creating an app and the exercise is not just limited to API access.

4) Once the users clicks the button, they get logged into a low code platform.  Note we have used screen mocks from WaveMaker low code platform.  But the user is not left in lurch.  He is not left to the mercy of documentation and forums to start integrating the APIs into the app.  A templatized app pre exists inside the platform with all the relevant artifacts for consuming the APIs and this  can help users to significantly speed up app creation.

5)  Inside the Movi app, pre-integrate with the most commonly used APIs in the application.  This will take away all the complexities associated with the API, like documentation, parameters, headers etc. and lets the user focus on just app business logic and end user experience

6) A well defined templated app inside a low code platform would also provide pre-existing drag-n-drop components like search widgets that have pre-built integrations to the search APIs.  This is value addition beyond just simple API integration.  Now we are talking about UI components that will let you build the customer user experience in front of your eyes using in-built WYSIWYG screens.  This is powerful, since you are not focussing on technology anymore, but business imperatives.

7) Low code platforms doesn't stop there.  It will not just let you build your app easily, but also test them take them to delivery fast.  It covers the entire app delivery life cycle.  Check out the 1-click testing and deploy features highlighted in the below figure.

If you noticed in the above article, it was the low code platform which is the unsung hero solving the bigger problem of API RoI.  Low code platforms in one swoop through its easy drag and drop based visual coding and app template based approach put a clean facade over technical complexities associated with APIs and coding and app.  Low code platforms lets you make an app from an idea in a matter of days instead of weeks, months and in some cases more than a year to create an app.

Benefits of the new API consumption model

The below picture captures all the benefits of the new model succinctly.

Conclusion
In the modern digital world, it's imperative for organizations to move up in the digital value chain.  Investing in a low code platform is one good way to do that.  What we discussed today is one such value proposition for companies with existing investment in API infrastructure.  But low code platform based solution can be successfully  applied for various other scenarios like faster response to the needs of the customer, enabling 3rd party digital channel stakeholders, and even empowering employees within a company.

More Stories By Karthick Viswanathan

Karthick heads the Products, Marketing and Evangelism efforts for WaveMaker. As one of the original product managers at WaveMaker, he led the technology and design for WaveMakerOnline, WaveMaker's PaaS offering. He also established the Customer Success practice for WaveMakerOnline. Prior to WaveMaker, Karthick occupied various roles in engineering and product management at PegaSystems, IBM and Oracle. He can discuss in-depth, code-level details and just as easily shift focus to business and go-to-market strategies. He was one of the seeders for the product management teams for PegaSystems in India and also a key technology contributor behind Oracle Warehouse Builder features. He writes and blogs about modern app development methodologies, including Rapid Application Development, digital transformation, and the API economy.

@CloudExpo Stories
SYS-CON Events announced today that SourceForge has been named “Media Sponsor” of SYS-CON's 21st International Cloud Expo, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. SourceForge is the largest, most trusted destination for Open Source Software development, collaboration, discovery and download on the web serving over 32 million viewers, 150 million downloads and over 460,000 active development projects each and every month.
SYS-CON Events announced today that DXWorldExpo has been named “Global Sponsor” of SYS-CON's 21st International Cloud Expo, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Digital Transformation is the key issue driving the global enterprise IT business. Digital Transformation is most prominent among Global 2000 enterprises and government institutions.
One of the biggest challenges with adopting a DevOps mentality is: new applications are easily adapted to cloud-native, microservice-based, or containerized architectures - they can be built for them - but old applications need complex refactoring. On the other hand, these new technologies can require relearning or adapting new, oftentimes more complex, methodologies and tools to be ready for production. In his general session at @DevOpsSummit at 20th Cloud Expo, Chris Brown, Solutions Marketi...
Cloud-based disaster recovery is critical to any production environment and is a high priority for many enterprise organizations today. Nearly 40% of organizations have had to execute their BCDR plan due to a service disruption in the past two years. Zerto on IBM Cloud offer VMware and Microsoft customers simple, automated recovery of on-premise VMware and Microsoft workloads to IBM Cloud data centers.
Elon Musk is among the notable industry figures who worries about the power of AI to destroy rather than help society. Mark Zuckerberg, on the other hand, embraces all that is going on. AI is most powerful when deployed across the vast networks being built for Internets of Things in the manufacturing, transportation and logistics, retail, healthcare, government and other sectors. Is AI transforming IoT for the good or the bad? Do we need to worry about its potential destructive power? Or will we...
Many organizations adopt DevOps to reduce cycle times and deliver software faster; some take on DevOps to drive higher quality and better end-user experience; others look to DevOps for a clearer line-of-sight to customers to drive better business impacts. In truth, these three foundations go together. In this power panel at @DevOpsSummit 21st Cloud Expo, moderated by DevOps Conference Co-Chair Andi Mann, industry experts will discuss how leading organizations build application success from all...
SYS-CON Events announced today that Daiya Industry will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Daiya Industry specializes in orthotic support systems and assistive devices with pneumatic artificial muscles in order to contribute to an extended healthy life expectancy. For more information, please visit https://www.daiyak...
SYS-CON Events announced today that SIGMA Corporation will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. uLaser flow inspection device from the Japanese top share to Global Standard! Then, make the best use of data to flip to next page. For more information, visit http://www.sigma-k.co.jp/en/.
The last two years has seen discussions about cloud computing evolve from the public / private / hybrid split to the reality that most enterprises will be creating a complex, multi-cloud strategy. Companies are wary of committing all of their resources to a single cloud, and instead are choosing to spread the risk – and the benefits – of cloud computing across multiple providers and internal infrastructures, as they follow their business needs. Will this approach be successful? How large is the ...
Your clients expect transactions to never fail, cloud access to be fast and always on, and their data to be protected - no exceptions. Hear about how Secure Service Container (SSC), an IBM-exclusive open technology, enables secure building and hosting of next-generation applications, both cloud and on-premises. SSC protects the full stack from external and insider threats, allows automatic encryption of data in-flight and at-rest, and is tamper-resistant during installation and runtime – with no...
With major technology companies and startups seriously embracing Cloud strategies, now is the perfect time to attend 21st Cloud Expo October 31 - November 2, 2017, at the Santa Clara Convention Center, CA, and June 12-14, 2018, at the Javits Center in New York City, NY, and learn what is going on, contribute to the discussions, and ensure that your enterprise is on the right path to Digital Transformation.
SYS-CON Events announced today that B2Cloud will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. B2Cloud specializes in IoT devices for preventive and predictive maintenance in any kind of equipment retrieving data like Energy consumption, working time, temperature, humidity, pressure, etc.
SYS-CON Events announced today that NetApp has been named “Bronze Sponsor” of SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. NetApp is the data authority for hybrid cloud. NetApp provides a full range of hybrid cloud data services that simplify management of applications and data across cloud and on-premises environments to accelerate digital transformation. Together with their partners, NetApp em...
SYS-CON Events announced today that Interface Corporation will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Interface Corporation is a company developing, manufacturing and marketing high quality and wide variety of industrial computers and interface modules such as PCIs and PCI express. For more information, visit http://www.i...
SYS-CON Events announced today that Massive Networks, that helps your business operate seamlessly with fast, reliable, and secure internet and network solutions, has been named "Exhibitor" of SYS-CON's 21st International Cloud Expo ®, which will take place on Oct 31 - Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. As a premier telecommunications provider, Massive Networks is headquartered out of Louisville, Colorado. With years of experience under their belt, their team of...
SYS-CON Events announced today that Mobile Create USA will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Mobile Create USA Inc. is an MVNO-based business model that uses portable communication devices and cellular-based infrastructure in the development, sales, operation and mobile communications systems incorporating GPS capabi...
SYS-CON Events announced today that Nihon Micron will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Nihon Micron Co., Ltd. strives for technological innovation to establish high-density, high-precision processing technology for providing printed circuit board and metal mount RFID tags used for communication devices. For more inf...
SYS-CON Events announced today that N3N will exhibit at SYS-CON's @ThingsExpo, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. N3N’s solutions increase the effectiveness of operations and control centers, increase the value of IoT investments, and facilitate real-time operational decision making. N3N enables operations teams with a four dimensional digital “big board” that consolidates real-time live video feeds alongside IoT sensor data a...
Enterprises are moving to the cloud faster than most of us in security expected. CIOs are going from 0 to 100 in cloud adoption and leaving security teams in the dust. Once cloud is part of an enterprise stack, it’s unclear who has responsibility for the protection of applications, services, and data. When cloud breaches occur, whether active compromise or a publicly accessible database, the blame must fall on both service providers and users. In his session at 21st Cloud Expo, Ben Johnson, C...
SYS-CON Events announced today that Suzuki Inc. will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Suzuki Inc. is a semiconductor-related business, including sales of consuming parts, parts repair, and maintenance for semiconductor manufacturing machines, etc. It is also a health care business providing experimental research for...