The Data Engineer Blog

Posted on February 10, 2023

I am very thankful for being awarded the MSSQLTips.com Rookie of the year. I am pleased that this award was based on the SSIS Bad Habits article series I published in 2022. A special thanks to Jeremy Kadlec, who encouraged me to complete this article series before the end of... [Read More]

Posted on February 6, 2023

This article illustrates how to use a Microsoft SQL Server Integration Services (SSIS) external configuration file to enable the properties of package objects to be dynamically updated at run time.

Posted on February 3, 2023

This article provides more than 50 questions that can be used within an SSIS job interview.

Posted on January 29, 2023

Tech Blog is a Medium publication that tends to publish technical articles, ideas, and tutorials. If you are interested in sharing your knowledge with us, please read the article writing guidelines and submission rules before submitting your first article.

Posted on January 20, 2023

In this article, we will reproduce the “Cannot convert between Unicode and non-Unicode string data types” exception and explain several solutions to this issue. [Read More]

Posted on January 17, 2023

This article gives an overview of the approaches to migrating SQL Server data to a MongoDB database. [Read More]

Posted on January 17, 2023

This article will show the SQL standard deviation function with several examples.

Posted on January 5, 2023

Dear Audience, 2022 was my first year as a contributing author for MSSQLTips.com. I have written an article series (6 articles) named “SSIS Bad Habits” where I explained several bad practices that decrease the SSIS packages performance. I am gload to annouce that I was recognized as a contender for... [Read More]

Posted on December 28, 2022

This article briefly explains the SQL group by clause, when it should be used, and what we should consider when using it.

Posted on December 1, 2022

This tip will explain some mistakes SSIS developers usually make when designing ETL and how they should be avoided.

Posted on November 18, 2022

This article explains what the SQL injection attack is, why it could be hazardous, and how to defend our SQL database from this attack using parameterized queries and some third-party tools.

Posted on August 4, 2022

This article explains when databases are not suitable for data staging and what formats SSIS developers should use to stage their data when ETL jobs are developed using SQL Server Integration Services.

Posted on June 22, 2022

This article explains the xp_cmdshell and sp_xp_cmdshell_proxy_account system stored procedures in SQL Server and how developers can use them to execute Windows commands.

Posted on June 7, 2022

This tutorial explains how lookups may highly decrease SSIS package performance and when they should only be used in Business Intelligence projects.

Posted on May 4, 2022

This tutorial will explain some of the mistakes that SSIS developers usually make when configuring the OLE DB component while designing SSIS packages and how they should avoid them.

Posted on April 19, 2022

This article explains data staging and staging methods in SSIS, and how to choose the appropriate approach while designing your data pipeline.

Posted on April 5, 2022

This tutorial explains the main cause of the performance problem faced while merging different data sources in SQL Server Integration Services and provides a few alternatives.

Posted on February 15, 2022

Is SSIS extension available for Visual Studio 2022?

Posted on January 18, 2022

This article gives an overview of DIFFERENCE and SOUNDEX SQL Server built-in system functions. It explains how to use those functions and how do they work.

Posted on January 16, 2022

This answer explains how to to loop over multiple flat files and insert them into seperate SQL Server tables.

Posted on January 13, 2022

Since many students and developers cannot pay for the certifications exams fees, I created a #GitHub repository to list all free professional exams provided by tech companies even if it was offered on a specific occasion (ex: Microsoft Ignite Cloud Skills Challenge). I will be grateful for any contribution. And... [Read More]

Posted on January 10, 2022

This article will explain how to create a SQL Server CLR function stored in a C# class library without creating a SQL Server database project. We will first briefly explain the concept of .NET common language runtime (CLR) and then build a C# class library using the .NET framework. Then,... [Read More]

Posted on December 30, 2021

This answer explains why the milliseconds part is removed when passing a DateTime value as a parameter in a OLE DB source SQL Command. Besides, it explains the different data types systems used in SSIS.

Posted on December 29, 2021

How to split a comma seperated value passed as a parameter to an SQL Command used in the SSIS OLE DB Source when the database does not support STRING_SPLIT() system function?

Posted on November 25, 2021

This article explains both the SSIS term extraction and term lookup components. Besides, it illustrates the use cases of each one of them.