The Wayback Machine - https://web.archive.org/web/20160420122730/http://cloudcomputing.sys-con.com/node/3734524

Welcome!

@CloudExpo Authors: Liz McMillan, Pat Romanski, Craig Lowell, Ruxit Blog, Anders Wallgren

Related Topics: IoT User Interface, Linux Containers, @CloudExpo, @BigDataExpo, OpenStack Journal

IoT User Interface: Article

DZone Guide to Data Persistence | @CloudExpo #DataCenter #Storage

Persistent data is fundamental to nearly any operation that utilizes database management systems (DBMS)

Data persistence has a way of sneaking up on developers. You start out with a simple, straightforward database that can functionally hold the data you're working with and the data you need to work with later. But as your needs change, you start to modify it here and there, until it becomes a brittle tangle of tables and keys and indexes. You need something more dynamic, but you need to retain the ability to retrieve your persistent data. Now, you're miles from where you started, and staring down the possibility of having to adopt a whole new system. That persistent data is fundamental to nearly any operation that utilizes database management systems (DBMS), but while the growth of dynamic data has led to sophisticated and reliable new relational management systems, real-world techniques for optimal data storage and retrieval have sometimes been lost in the shuffle. With that in mind, we've put together a new edition of our comprehensive DZone Guide to Data Persistence.

More than 580 IT professionals responded to our 2016 Data Persistence Survey, and those responses yielded noteworthy results that we've translated into a tool to answer all your persistent data-related questions.

The demographics of the respondents varied somewhat widely, and that variance helped provide a clear picture of the industry:

  • 69 percent of respondents use Java as their primary programming language at work
  • 68 percent develop primarily web applications
  • 66 percent have been IT professionals for more than 10 years
  • 45 percent work at companies headquartered in Europe, 27 percent in the United States
  • 44 percent work at companies with more than 500 employees, 19 percent with more than 10,000 employees

We've channeled our findings into a comprehensive resource containing persistence strategies, tools for data storage and retrieval, a checklist for choosing the right database, and an analysis of trends in the DBMS space. Among some of the more fascinating kernels of information was the surprise reveal that nearly 22 percent of the respondents didn't know whether their databases were partitioned or not. This means that nearly a quarter of developers can build applications without knowing how their database handles scale. As a result, database administrators have to be able to distribute large amounts of data under flexible read/write conditions, keeping storage abstraction as tight as possible. We also found that Oracle, MySQL and SQL Server are still the go-to servers in the commercial DBMS world, and it's not really even close. In fact, it's been years since the top three servers have faced any real challenge in both production and non-production environments.

Really, though, these findings are just the tip of the iceberg. In this guide, we've included chapters on the impact of fundamental data structures on storage and retrieval, ORM libraries for Android and iOS, how to choose a DBaaS, executive insights into data persistence, and a directory of over 50 solutions (various kinds of DBMS, ORMs, SQL generators, data grids, and more). We've designed this guide with developers in mind. Dealing with data persistence shouldn't be a headache, and these tools should help cut through some of the complexity.

Give it a read and tell us what you think!

More Stories By John Esposito

John Esposito is Editor-in-Chief at DZone, having recently finished a doctoral program in Classics from the University of North Carolina. In a previous life he was a VBA and Force.com developer, DBA, and network administrator. John enjoys playing piano and looking at diagrams, and raises two cats with his wife, Sarah.

@CloudExpo Stories
Angular 2 is a complete re-write of the popular framework AngularJS. Programming in Angular 2 is greatly simplified – now it's a component-based well-performing framework. This immersive one-day workshop at 18th Cloud Expo, led by Yakov Fain, a Java Champion and a co-founder of the IT consultancy Farata Systems and the product company SuranceBay, will provide you with everything you wanted to know about Angular 2.
Managed IT services wasn't even a phrase until the early 2000s and, today, there are over 75,000 IT service providers in North America alone. By 2020, there are going to be 50 billion connected devices, and managed IT services might cease to be a phrase again. Unless the MPSs adapt to the new, connected world, we are going to see diminishing returns in that space. In his session at @ThingsExpo, Kirill Bensonoff, CEO of Unigma, will discuss the different opportunities IoT will create for MSPs a...
You deployed your app with the Bluemix PaaS and it's gaining some serious traction, so it's time to make some tweaks. Did you design your application in a way that it can scale in the cloud? Were you even thinking about the cloud when you built the app? If not, chances are your app is going to break. Check out this webcast to learn various techniques for designing applications that will scale successfully in Bluemix, for the confidence you need to take your apps to the next level and beyond.
Machine Learning helps make complex systems more efficient. By applying advanced Machine Learning techniques such as Cognitive Fingerprinting, wind project operators can utilize these tools to learn from collected data, detect regular patterns, and optimize their own operations. In his session at 18th Cloud Expo, Stuart Gillen, Director of Business Development at SparkCognition, will discuss how research has demonstrated the value of Machine Learning in delivering next generation analytics to im...
Across nearly every industry, innovative entrants are disrupting traditional markets and displacing long-established players. This IBM Point of View white paper describes the IBM Bluemix Garage Method that was created to support the October 19, 2015 launch.
The paradigm has shifted. A Gartner survey shows that 43% of organizations are using or plan to implement the Internet of Things in 2016. However, not just a handful of companies are still using the old-style ad-hoc trial-and-error ways, unaware of the critical barriers, paint points, traps, and hidden roadblocks. How can you become a winner? In his session at @ThingsExpo, Tony Shan will present a methodical approach to guide the holistic adoption and enablement of IoT implementations. This ov...
If there is anything we have learned by now, is that every business paves their own unique path for releasing software- every pipeline, implementation and practices are a bit different, and DevOps comes in all shapes and sizes. Software delivery practices are often comprised of set of several complementing (or even competing) methodologies – such as leveraging Agile, DevOps and even a mix of ITIL, to create the combination that’s most suitable for your organization and that maximize your busines...
Up until last year, enterprises that were looking into cloud services usually undertook a long-term pilot with one of the large cloud providers, running test and dev workloads in the cloud. With cloud’s transition to mainstream adoption in 2015, and with enterprises migrating more and more workloads into the cloud and in between public and private environments, the single-provider approach must be revisited. In his session at 18th Cloud Expo, Yoav Mor, multi-cloud solution evangelist at Cloudy...
SYS-CON Events announced today that DatacenterDynamics has been named “Media Sponsor” of SYS-CON's 18th International Cloud Expo, which will take place on June 7–9, 2016, at the Javits Center in New York City, NY. DatacenterDynamics is a brand of DCD Group, a global B2B media and publishing company that develops products to help senior professionals in the world's most ICT dependent organizations make risk-based infrastructure and capacity decisions.
SYS-CON Events announced today that Stratoscale, the software company developing the next generation data center operating system, will exhibit at SYS-CON's 18th International Cloud Expo®, which will take place on June 7-9, 2016, at the Javits Center in New York City, NY. Stratoscale is revolutionizing the data center with a zero-to-cloud-in-minutes solution. With Stratoscale’s hardware-agnostic, Software Defined Data Center (SDDC) solution to store everything, run anything and scale everywhere...
Panzura has announced the results of its “State of Manufacturing Cross Site-CAD Collaboration” survey conducted at SOLIDWORKS World 2016. The survey details the top challenges that manufacturing professionals face when working within Computer Aided Design (CAD)/Computer Aided Manufacturing (CAM) and design applications across sites. More than 5,000 manufacturing professionals attended SOLIDWORKS World 2016, with a significant portion participating in the “State of Manufacturing Cross-Site CAD C...
SYS-CON Events announced today TMCnet has been named “Media Sponsor” of SYS-CON's 18th International Cloud Expo, which will take place on June 7–9, 2016, at the Javits Center in New York City, NY, and the 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. Technology Marketing Corporation (TMC) is the world's leading business-to-business and integrated marketing media company, servicing niche markets within the com...
This is not a small hotel event. It is also not a big vendor party where politicians and entertainers are more important than real content. This is Cloud Expo, the world's longest-running conference and exhibition focused on Cloud Computing and all that it entails. If you want serious presentations and valuable insight about Cloud Computing for three straight days, then register now for Cloud Expo.
Between the mockups and specs produced by analysts, and resulting applications built by developers, there exists a gulf where projects fail, costs spiral, and applications disappoint. Methodologies like Agile attempt to address this with intensified communication, with partial success but many limitations. In his session at 18th Cloud Expo, Charles Kendrick, CTO & Chief Architect at Isomorphic Software, will present a revolutionary model enabled by new technologies. Learn how business and devel...
Culture is the most important ingredient of DevOps. The challenge for most organizations is defining and communicating a vision of beneficial DevOps culture for their organizations, and then facilitating the changes needed to achieve that. Often this comes down to an ability to provide true leadership. As a CIO, are your direct reports IT managers or are they IT leaders? The hard truth is that many IT managers have risen through the ranks based on their technical skills, not their leadership ab...
The proper isolation of resources is essential for multi-tenant environments. The traditional approach to isolate resources is, however, rather heavyweight. In his session at 18th Cloud Expo, Igor Drobiazko, co-founder of elastic.io, will draw upon their own experience with operating a Docker container-based infrastructure on a large scale and present a lightweight solution for resource isolation using microservices. He will also discuss the implementation of microservices in data and applicat...
How do you evaluate a cloud provider for your database platform? How do you coordinate the diverse moving parts that must come together when developing your IoT product? What are the key challenges addressed by Data as a Service? DevOps, Digital, Cloud – three separate transformative trends, or one mega-trend? Which cloud model is right for your company? How can you turn your corporate data into dollars?
The IoT has the potential to create a renaissance of manufacturing in the US and elsewhere. In his session at 18th Cloud Expo, Florent Solt, CTO and chief architect of Netvibes, will discuss how the expected exponential increase in the amount of data that will be processed, transported, stored, and accessed means there will be a huge demand for smart technologies to deliver it. Florent Solt is the CTO and chief architect of Netvibes. Prior to joining Netvibes in 2007, he co-founded Rift Technol...
Cloud Expo, Inc. has announced today that Andi Mann returns to 'DevOps at Cloud Expo 2016' as Conference Chair The @DevOpsSummit at Cloud Expo will take place on June 7-9, 2016, at the Javits Center in New York City, New York. "DevOps is set to be one of the most profound disruptions to hit IT in decades," said Andi Mann. "It is a natural extension of cloud computing, and I have seen both firsthand and in independent research the fantastic results DevOps delivers. So I am excited to help the g...
Quantum Corp. has announced three new reference architectures to optimize key surveillance and security environments, addressing the storage challenges presented by new fixed cameras, expansions of existing security systems, and law enforcement implementations. The reference architectures provide the storage performance, capacity and accessibility that customers and integrators require at the foundation of today's new surveillance and security installations.