Handling NUL (\x00) value in flat files using SQL Server Integration Services.
SSIS Flat file could not deal with NUL (\x00) value
Stack Overflow
An efficient approach to process a SSAS multidimensional OLAP cube
SQL Shack
While building and deploying an SSAS OLAP cube, there are two processing orders that you can choose from when you create a process operation: Parallel (All Objects will be processed in a single transaction): Used for batch processing, all tasks run in parallel inside one transaction. Sequential (Transaction mode): One...
[Read More]
C# Script in SSIS Script Task to convert Excel Column in "Text" Format to "General"
Stack Overflow
Using NumberFormat property while manipulating Microsoft Excel worksheets using SSIS.
C# - Extract objects from SQL Command
Data Developers
How can I extract all objects mentioned in a SQL Command using C#?
Do you really need to implement Big Data technologies in your ecosystem?
Towards Data Science
From many years, “Big Data” has become widespread and trendy. The Big Data technologies started to fill the gap between the traditional data technologies (RDBMS, File systems … ) and the high evolution of the data and business needs. While implementing these technologies is a must for many large-scale organization...
[Read More]
Fast load error output doesn't redirect entire batch
Stack Overflow
Explaining the validation types performed when using OLE DB destination component in SSIS
Report dates not working correctly if date format is not mm/dd/yyyy
Stack Overflow
Trying to fix out the date time format issue in SQL Server Reporting Services.
Retrieve multidimensional database objects directories
Stack Overflow
Explaining the contents hierarchy of the SSAS multidimensional cube data directory.
SSIS Script Task error: Exception has been thrown by the target of an invocation
Data Developers
Hanlding SSIS script task error: “Exception has been thrown by the target of an invocation”
How to load mixed record type fixed width file with two headers into two separate files?
Stack Overflow
A step-by-step guide to split a mixed record type fixed width file having two headers into two separate flat files.
Announcing SchemaMapper a C# data integration class library
Tech Blog
SchemaMapper is a C# data integration class library that facilitates data import process from external sources having different schema definitions.
How to Map Input and Output Columns dynamically in SSIS?
Stack Overflow
Some ideas for to develop a dynamic approach fr mapping input and output columns automatically in SSIS data import operations.
How can I fix the number of groups in each page of SSRS
Stack Overflow
Dividing reports into multiple groups using SQL Server reporting services.
Date calculation with parameter in SSIS is not giving the correct result
Stack Overflow
Explaining the cause of the difference between data values generated in SQL Server and the SSIS OE DB Source SQL command.
Ad-Hoc networks QoS and Security overview
Tech Blog
Ad-hoc networks Quality of Service parameters
RaDEn: A Scalable and Efficient Radiation Data Engineering
BDCSIntell'2018
Detecting and monitoring radiation level is one of the critical duties for governments and researchers because of the high threats it oppose to humans. It was challenging in the past century to have a centralized radiation monitoring system until the rise of IoT (Internet of Things). Radiation level is measured...
[Read More]
An Introduction to Data quality
Towards Data Science
There are many definitions of data quality, in general, data quality is the assessment of how much the data is usable and fits its serving context.
Big Data Integration
Towards Data Science
Data integration is a set of processes used to retrieve and combine data from disparate sources into meaningful and valuable information. A complete data integration solution delivers trusted data from a variety of sources. Traditional data integration techniques was mainly based on ETL (extract, transform and Load) process to ingest...
[Read More]
Pricing on the Cloud
Towards Data Science
Cloud Computing is a vital practice of the online provisioning of computing resources as services. Moreover, as defined in Oxford online dictionary, it is “The practice of using a network of remote servers hosted on the Internet to store, manage, and process data, rather than a local server or a...
[Read More]
Getting Started With Apache Spark, Python and PySpark
Towards Data Science
This article is a quick guide to Apache Spark single node installation, and how to use Spark python library PySpark.
How Information Technologies influenced Risk Management?
Towards Data Science
Risk management is a much-needed core competency that helps organizations deliver and increase stakeholder value over time. A good risk management requires better data and information, so organizations can take action on an ever-evolving inventory of risks. Risk management teams must facilitate and encourage the capture, analysis, and delivery of...
[Read More]
Getting Started with Apache Kafka and Apache Flume (Import data to HDFS)
Towards Data Science
This article contains a complete guide for Apache Kafka installation, creating Kafka topics, publishing and subscribing Topic messages. In addition, it contains Apache Flume installation guide and how to import Kafka topic messages into HDFS using Apache Flume.
Installing Hadoop 3.1.0 multi-node cluster on Ubuntu 16.04 Step by Step
Towards Data Science
There are many links on the web about install Hadoop 3. Many of them are not working well or need improvements. This article is taken from the official documentation and other articles in addition of many answers from Stackoverflow.com
How to check column structure in ssis?
Stack Overflow
A solution for validating flat files headers using SSIS script component.
Automate Version number Retrieval from .Dtsx files
Stack Overflow
A solution for retrieving the SSIS packages metadata without installing SQL Server nor Integration Services.