DATATYPE

A Data Lake is a data storage repository where data can be stored in its native format regardless of whether it is in an unstructured, semi-structured, or structured form. Advanced ones like the SAP data lake are capable of achieving more. This is why organizations are increasingly incorporating data lakes into their existing IT infrastructure for improved database performance at very cost-effective rates. The Launch of the SAP data lake SAP launched HANA Data Lake in April 2020. The mission was to provide clients with a very cost-effective yet high-performance and advanced data storage system. The full package had a native storage extension as well as a relational SAP data lake that was available out of the box. This brought the SAP data lake at par with other leaders in the cloud-based ecosystem such as Microsoft Azure and Amazon S3 (Simple Storage Service) so far as data processing competencies and other functionalities are concerned. SAP data lake was launched with a host of i...

Amazon Web Service Database Migration Service (AWS DMS) is an optimized cloud-based platform used primarily to migrate databases from on-premises systems to the cloud or from one cloud provider to another. With AWS DMS , you can choose either one-time migration of databases or have continual replication of changes to data made at the source database to the target database. However, for this to happen, both the source and the target databases must be continually in sync. AWS DMS migrates databases between relational databases, NoSQL databases, and data warehouses. It functions only when the source and the target databases are linked so that it can know from where to extract the data and where to load it to. The next step for database migration is to specify the activity that will replicate the data from the source to the target. What makes AWS DMS stand out is that it fully automates the migration process and no human intervention is required at any stage. This is applicable even w...

  This post will take you through the process of connecting a database on SQL Server to Azure Synapse so that Azure Synapse Analytics can access data from the SQL Server. But first, a word on SQL Server and Azure Synapse. Microsoft SQL Server Microsoft SQL Server is an RDMS (Relational Database Management System) that complements the whole suite of Microsoft .NET framework and supports applications either on a single machine or local area network across the web. The database is based on the popular programming language SQL and together with Oracle database and IBM’s DB2, has for long been among the leading database technologies in the world. Azure Synapse Azure Synapse is an analytics service that combines enterprise data warehousing and Big Data analytics. You can query data through either server-less or provisioned resources at scale. With Azure Synapse, these two can be used to ingest, prepare, manage, and serve data for machine learning and BI requirements. SQL Server to Azur...

Before checking on why organizations want to migrate databases from  Oracle to Snowflake   to reap the benefits offered by a cloud-based platform, a quick look at the two will be in order. This post will also go into the process of migration. Oracle Database A product of the Oracle Corporation, Oracle is a relational database management system offering businesses a wide range of editions to choose from as per their specific needs. This includes the Enterprise Edition, Personal Edition, Express Edition, and Standard Edition. Oracle database system provides maximized and affordable solutions for applications and data management and is primarily designed for data warehousing and grid computing. Snowflake Snowflake is a cloud-based data warehousing solution that has all the cutting-edge advantages of the cloud, the main being optimizing a data lake approach regardless of where the data is located. One of the primary reasons for migrating databases from Oracle to Snowflake   i...

  The Database Migration Service of the Amazon Web Service, popularly known as AWS DMS is an optimized platform based in the cloud. It helps to migrate databases from on-premises systems to the cloud or from one cloud provider to another. Users can either choose between one-time migration of a complete database or continuous replication of data between the source and the target databases provided both are always kept in sync. It is an ideal service to migrate data from relational databases, NoSQL databases, and data warehouses. How does AWS DMS work? If AWS DMS is to function, the first task of DBAs is to establish a link between the source and the target databases. This will enable the service to recognize from where and to what destination the data has to be migrated. Once this is done, the activity that will be used to load the data from the source to the target has to be defined. The critical benefit of AWS DMS is that the process is completely automated at all levels. Thi...

Oracle Database Management system was first released commercially in 1979 and offers Online Transaction Processing (OLTP) and data warehousing platforms. Oracle Change Data Capture ( CDC) was first launched along with the 9i version to record and track all changes made by users in database tables. The changes were stored in change tables for use in ETL applications for later processing and storing in other data warehouses and databases. The launch version of Oracle Change Data Capture worked through triggers that were placed in source databases. This technology was considered too invasive and did not find favor with DBAs. Eventually, Oracle released a modified form with its 10g version and named it Oracle Streams. The model of the Oracle Change Data Capture used the redo logs of the source database along with an in-built tool for replication present in Oracle Streams. This mode of Oracle Change Data Capture turned out to be a highly successful method to detect and move change data...

SAP Extractor captures and prepares data via an extract structure that is transferable to the Business Warehouse (BW) of SAP. It is a program in SAP ERP and can either be customized or taken from a standardized Data Source. Both the options assist in describing a delta load process or various types of full load with the SAP BW being able to access remotely the data transfer facets of the SAP Extractor.   The point now to consider is whether all data will be lost if the SAP Extractor is moved to S/4HANA or even other SAP BW Extractors that are compatible with S/4HANA. Let’s analyze what happens in such cases. The SAP ECC system can only be used for operational and transactional purposes and not for any form of analysis. Hence, to analyze ECC data, the SAP Extractor is used to extract data from the SAP ECC system to be moved to the SAP Business Warehouse system. Therefore, given this factor, it can be said that an SAP Extractor is a link between the CC system and that of the BW. ...