If you’ve made it to this blog you’ve probably heard the term“persistent” thrown around with ETL,and are curious about what they really mean together. Extract, Transform, Load(ETL) is the generic concept of taking data from one or more systems and placing it in another system, often in a different format. Persistence is just a fancy word for storing data. Simply put, persistent ETL isadding a storage mechanism to an ETL process. That pretty much covers the what, but the why is much more interesting…
In the oil and gas industry, pipelines are an essential component of the business, essentially transporting product from its source to a destination, where it can be processed to meet client requirements. As new product sources are found and exploited, they are integrated into existing pipelines for transport to their ultimate destinations. In the subsea oil and gas market, this term is called a tieback and greatly reduces the overall costs for overall project, as it leverages existing infrastructure to support the new fields. Technological advances have allowed operators to increase the distances for these tiebacks by offering in field processing to assure that there is consistent flow within their pipelines. Subsea processing close to the edgeallows operators to add new fields to existing pipelines in a very cost effective manner.
According to Wikipedia,“Polyglot persistence is the concept of using different data storage technologies to handle different data storage needs within a given software application.” James Serra, in his blog writes, “Polyglot Persistence is a fancy term to mean that when storing data, it is best to use multiple data storage technologies, chosen based upon the way data is being used by individual applications or components of a single application. Different kinds of data are best dealt with different data stores. “
Those that know me today may be shocked to hear that I was a quiet, shy, nerdy kid in high school. Well, at least the shy and quiet part, I probably still have the nerdy part covered.Back then, like most kids, I had no idea what I wanted to do in life.I liked playing with gadgets, but didn’t know how to turn that into a career. One day I heard an announcement about an interest meeting for the school’s robotics team and figured I’d check it out.It’s been over a decade since I walked into that classroom and I’m still involved with the team and the organization.