ssismhash Wiki & Documentation Rss Feed

Updated Wiki: Home

kmartin — Thu, 29 Nov 2012 02:20:29 GMT

Creator: Keith Martin

Description: SSIS Multiple Hash makes it possible to generate many Hash values from each input row. Hash's supported include MD5 and SHA1.

Download:
The Default Download is for SQL Server 2012. If you are using SQL 2005, 2008 or 2008R2, then please select the appropriate download from the View All Downloads link to the right.

Design Page Example

Meta Data from Example

Main Project Site: http://ssismhash.codeplex.com/

Source Download: SSIS Multiple Hash on Codeplex, Source Code Tab
Binary Download: SSIS Multiple Hash on Codeplex, Releases Tab

Instructions: SSIS Multiple Hash Component Wiki
Programming: Programmatically Creating a Multiple Hash component in a Data Flow

This component has now been updated to version 1.6.1.
This release corrects a bug for systems with greater than 32 cores.

nb. If using a previous version on a system with greater than 32 cores, disable Multiple Threading as a work around.

Version 1.6 Details:
This release corrects a bug in date time handling, where milliseconds were not being hashed. Updating the component will NOT automatically correct this in existing packages. You will have to tick the box Milliseconds to enable this. This has been done to preserve backwards compatability.

If you are not hashing Date Time data types with a requirement for millisecond precision, then you don't need to update your component version.

Version 1.5.1 Details:
This release improves performance significantly, and corrects a UI defect in multiple select.

Version 1.5 Details:
This release adds 4 new Hash algorithms, and corrects a defect in the multiple select capability.

Version 1.4.1 Details:
This release adds multiple select/deselect capability to the Input and Output tabs for the check box columns.

Version 1.4 Details:
This release improves the UI for selection of columns in the Hash, and the ordering of these columns.
It also includes SQL 2012 support.

Version 1.3.1 Details:
Corrects an issue with Multiple Threading and Thread Safe not being enabled.

Version 1.3 Details:
This release adds the ability to upgrade an SQL 2005 package to SQL 2008.
This release adds the ability to detect the following scenarios:

Version 1.2.1 or lessor

Col 1	Col 2	Col 3	Hash
Text	NULL	Text 2	0x123456
Text	Text 2	NULL	0x123456
NULL	Text	Text 2	0x123456

Version 1.3 without Safe Ticked (This is the default action on an update)

Col 1	Col 2	Col 3	Hash
Text	NULL	Text 2	0x123456
Text	Text 2	NULL	0x123456
NULL	Text	Text 2	0x123456

Version 1.3 with Safe Ticked (You have to enable this in your existing packages)

Col 1	Col 2	Col 3	Hash
Text	NULL	Text 2	0x123564
Text	Text 2	NULL	0x124563
NULL	Text	Text 2	0x823456

Note that all the hashes are different in this case, and they are different from those generated by the older versions.
This is because columns that are variable length will have their length appended to a string at the end of the hash data, and all columns will have their NULL status added to the same string. That string is then added to the data read in, and hashed.

Review(s):

Updated Wiki: Documentation

kmartin — Thu, 29 Nov 2012 02:19:57 GMT

Usage Instructions

The following should assist you in using this component.

Installation

After downloading the appropriate setup files, unzip them, and execute the Setup.exe file.

If you have a previous version (1.0, 1.1, 1.2, 1.2.1, 1.3 or 1.3.1) you will get a dialog box informing you that you must uninstall the previous version.
Do this, and then restart the installation.

Once the installation has completed, you will need to start BIDS, and add the new component into the Toolbox.
This is done as follows:

Add a data flow task into a new Integration Services package
Open the data flow task
Display the Toolbox
Right click the Data Flow Transformations within the Toolbox
Select Choose Items
Switch to the SSIS Data Flow Items tab
Tick the check box next to Multiple Hash in the list
Ok your way out of the dialog boxes

Inputs

The component needs a single input.

Outputs

The component generates a single output. This output will add new columns to your data flow that will be Binary data from the Hash functions.
The following Hash functions are supported:

Hash	Size
MD5	16
Ripe MD 160	20
SHA1	20
SHA256	32
SHA384	48
SHA512	64
CRC32	4
CRC32C	4
FNV1a 32	4
FNV1a 64	8

Configuration

Input Columns Tab
Output Columns Tab

Usage

To use, drop the component on the design surface.
Connect it to a Data Flow Source
Edit the component
Select the Input Columns Tab (should already be active)
Tick the columns that will be used for generation of the hash's. If planning more than one hash, then ensure that you select the columns for all hash's to be generated.
If you will have a large number of output columns, and will be excuting on a multi core machine, then consider enabling the Multiple Threading
1. None will not do Multiple Threading
2. Auto will do some basic checking, before enabling multiple threading (number of CPU's, and Number of Outputs)
3. On will enable multiple threading (regardless of the number of CPU Core's etc.
Switch to the Output Columns Tab
In the Output Columns list, enter a new column name, and then select the Hash function
The list to the right should now be populated with the columns that you selected on the Input Columns Tab.
Tick the columns that you wish to use for this Hash.
Repeat 8 though 10 until finished.
Add a Data Flow Destination
Connect the Output from the component to the Data Flow Destination
Run your SSIS component...

Programming

See the following article:
Programmatically Creating a Multiple Hash component in a Data Flow

Updated Wiki: Programmatically Creating a Multiple Hash component in a Data Flow

kmartin — Thu, 29 Nov 2012 02:18:59 GMT

The following is a bit of "sample" code that can be used to create a SSIS package that reads from master.sys.databases, and then passes each row into Multiple Hash, and generates a single hash from the entire input row. There is no additional components to do anything with the output from the Multiple Hash component shown in the example.

You will need to add references to:
Microsoft.SqlServer.DTSPipelineWrap
Microsoft.SQLServer.DTSRuntimeWrap
Microsoft.SQLServer.ManagedDTS
in your project.

using System;
using System.Collections.Generic;
using System.Linq;
using System.Text;
using Microsoft.SqlServer.Dts.Runtime;
using Microsoft.SqlServer.Dts.Pipeline;
using Microsoft.SqlServer.Dts.Pipeline.Wrapper;

namespace GenerateSSISPackage
{
    class Program
    {
        static void Main(string[] args)
        {
            String lineageIDs = string.Empty;
            Package package;
            Application app = new Application();
            package = new Package();

            // Add a data flow task to the package.
            Executable dataFlowTask = package.Executables.Add("STOCK:PipelineTask");
            TaskHost taskHost = dataFlowTask as TaskHost;

            // Name the task
            taskHost.Name = "Data Flow Task";
            // We need a reference to the InnerObject to add items to the data flow
            MainPipe pipeline = taskHost.InnerObject as MainPipe;

            // Create a OLEDB connection to the master database (on an instance called SQL2008R2)
            ConnectionManager connection = package.Connections.Add("OLEDB");
            connection.Name = "Source Connection";
            connection.ConnectionString = @"Data Source=.\SQL2008R2;Initial Catalog=master;Provider=SQLNCLI10.1;Integrated Security=SSPI;Auto Translate=False;";

            // Provide the required properties for the OLEDB connection
            IDTSComponentMetaData100 srcComponent = pipeline.ComponentMetaDataCollection.New();
            srcComponent.ComponentClassID = "DTSAdapter.OleDbSource";
            srcComponent.ValidateExternalMetadata = true;
            IDTSDesigntimeComponent100 srcDesignTimeComponent = srcComponent.Instantiate();
            srcDesignTimeComponent.ProvideComponentProperties();
            srcComponent.Name = "OleDb Source";

            // Configure it to read from sys.databases
            srcDesignTimeComponent.SetComponentProperty("AccessMode", 0);
            srcDesignTimeComponent.SetComponentProperty("OpenRowset", "[sys].[databases]");

            // Set the connection manager
            srcComponent.RuntimeConnectionCollection[0].ConnectionManager = DtsConvert.GetExtendedInterface(connection);
            srcComponent.RuntimeConnectionCollection[0].ConnectionManagerID = connection.ID;

            // Retrieve the column metadata
            srcDesignTimeComponent.AcquireConnections(null);
            srcDesignTimeComponent.ReinitializeMetaData();
            srcDesignTimeComponent.ReleaseConnections();


            //
            // Add the Multiple Hash
            //

            // If you want to see all the components on your machine, uncomment the following code.  The CreationName is what you place into the PipelineComponentInfos
            //foreach (PipelineComponentInfo pci in app.PipelineComponentInfos)
            //{
            //    Console.WriteLine(String.Format("{0}, {1}, {2}", pci.CreationName, pci.Description, pci.FileName));
            //}

            // Create a new object in the Pipeline
            IDTSComponentMetaData100 metaDataMultipleHash = pipeline.ComponentMetaDataCollection.New();
            // Name it
            metaDataMultipleHash.Name = "Multiple Hash Test";
            // Assign it to the Multiple Hash component.
            metaDataMultipleHash.ComponentClassID = app.PipelineComponentInfos["Martin.SQLServer.Dts.MultipleHash, MultipleHash2008, Version=1.0.0.0, Culture=neutral, PublicKeyToken=51c551904274ab44"].CreationName;
            // Instantiate the component, so that we can configure it.
            CManagedComponentWrapper instance = metaDataMultipleHash.Instantiate();

            // Initialize the component
            instance.ProvideComponentProperties();
            instance.ReinitializeMetaData();

            // Set suitable defaults
            metaDataMultipleHash.CustomPropertyCollection["MultipleThreads"].Value = 1; // Auto
            metaDataMultipleHash.CustomPropertyCollection["SafeNullHandling"].Value = 1; // True

            // Create a path from the source component to the new Multiple Hash component
            IDTSPath100 path = pipeline.PathCollection.New();
            path.AttachPathAndPropagateNotifications(srcComponent.OutputCollection[0], metaDataMultipleHash.InputCollection[0]);

            // Select which columns are to be hashed

            // Grab the input from the Multiple Hash component
            IDTSInput100 destInput = metaDataMultipleHash.InputCollection[0];
            IDTSVirtualInput100 destVirInput = destInput.GetVirtualInput();

            // This just selects all the columns!
            // If you were to be doing named columns, then you would find them in the collection.
            // And you would only SetUsageType to those specific columns.
            // Iterate through the virtual input column collection.
            foreach (IDTSVirtualInputColumn100 vColumn in destVirInput.VirtualInputColumnCollection)
            {
                // Call the SetUsageType method of the destination
                //  to add each available virtual input column as an input column.
                instance.SetUsageType(
                   destInput.ID, destVirInput, vColumn.LineageID, DTSUsageType.UT_READONLY);

                // As we are only going to do a single output in this example, just string all the input's ID's into the lineage string...
                if (string.IsNullOrEmpty(lineageIDs))
                    lineageIDs = "#" + vColumn.LineageID.ToString();
                else
                    lineageIDs += ",#" + vColumn.LineageID.ToString();
            }


            // Create a new output column
            IDTSOutputColumn100 outputColumn = instance.InsertOutputColumnAt(metaDataMultipleHash.OutputCollection[0].ID, 0, "OutputCol1", "Output Column 1");
            // Set the Hash Type.  The available hashes are 1 = MD5, 2 = RipeMD160, 3 = SHA1, 4 = SHA256, 5 = SHA384, 6 = SHA512, 7 = CRC32, 8 = CRC32C, 9 = FNV1a32, 10 = FNV1a64
            outputColumn.CustomPropertyCollection["HashType"].Value = 1; // MD5

            // Set the list of lineage id's that will be hashed for this column.
            outputColumn.CustomPropertyCollection["InputColumnLineageIDs"].Value = lineageIDs;

            // You should add a destination and another Path here from Multiple Hash to the destination.
            // Details for this are http://msdn.microsoft.com/en-us/library/ms136086.aspx

            // Save the package.
            app.SaveToXml(@"E:\Temp\Test.dtsx", package, null);

        }
    }
}

Updated Wiki: Home

kmartin — Sun, 04 Nov 2012 11:28:07 GMT

Creator: Keith Martin

Description: SSIS Multiple Hash makes it possible to generate many Hash values from each input row. Hash's supported include MD5 and SHA1.

Download:
The Default Download is for SQL Server 2012. If you are using SQL 2005, 2008 or 2008R2, then please select the appropriate download from the View All Downloads link to the right.

Design Page Example

Meta Data from Example

Main Project Site: http://ssismhash.codeplex.com/

Source Download: SSIS Multiple Hash on Codeplex, Source Code Tab
Binary Download: SSIS Multiple Hash on Codeplex, Releases Tab

Instructions: SSIS Multiple Hash Component Wiki

This component has now been updated to version 1.6.1.
This release corrects a bug for systems with greater than 32 cores.

nb. If using a previous version on a system with greater than 32 cores, disable Multiple Threading as a work around.

Version 1.6 Details:
This release corrects a bug in date time handling, where milliseconds were not being hashed. Updating the component will NOT automatically correct this in existing packages. You will have to tick the box Milliseconds to enable this. This has been done to preserve backwards compatability.

If you are not hashing Date Time data types with a requirement for millisecond precision, then you don't need to update your component version.

Version 1.5.1 Details:
This release improves performance significantly, and corrects a UI defect in multiple select.

Version 1.5 Details:
This release adds 4 new Hash algorithms, and corrects a defect in the multiple select capability.

Version 1.4.1 Details:
This release adds multiple select/deselect capability to the Input and Output tabs for the check box columns.

Version 1.4 Details:
This release improves the UI for selection of columns in the Hash, and the ordering of these columns.
It also includes SQL 2012 support.

Version 1.3.1 Details:
Corrects an issue with Multiple Threading and Thread Safe not being enabled.

Version 1.3 Details:
This release adds the ability to upgrade an SQL 2005 package to SQL 2008.
This release adds the ability to detect the following scenarios:

Version 1.2.1 or lessor

Col 1	Col 2	Col 3	Hash
Text	NULL	Text 2	0x123456
Text	Text 2	NULL	0x123456
NULL	Text	Text 2	0x123456

Version 1.3 without Safe Ticked (This is the default action on an update)

Col 1	Col 2	Col 3	Hash
Text	NULL	Text 2	0x123456
Text	Text 2	NULL	0x123456
NULL	Text	Text 2	0x123456

Version 1.3 with Safe Ticked (You have to enable this in your existing packages)

Col 1	Col 2	Col 3	Hash
Text	NULL	Text 2	0x123564
Text	Text 2	NULL	0x124563
NULL	Text	Text 2	0x823456

Updated Wiki: ConfigOutputTab

kmartin — Sun, 21 Oct 2012 11:54:42 GMT

Output Columns Tab

This tab allows you to:

add new output columns
rename existing output columns
change the Hash function used on output columns
select which input columns are used for a hash
change the order of the input columns used for a hash

Usage

In the Output Columns grid, select the output column (or if none entered, the first row).
Add/Change the column name
Select the Hash Function.
If you select the Hash Function first, then a column name will be auto generated for you. I recommend changing this name to one more appropriate to your function.
Tick the columns that you want in the Hash. These will be populated into the Rightmost grid, in the order that you select them.

If you have selected columns in the wrong order, then you can use the Move Up and Move Down buttons to change the order.

New in 1.4.1 is the ability to highlight a number of rows in the middle list, and select/deselect them as a group. Just ensure that you have the shift key pressed when you click in the checkbox at the bottom of your group selection.
You can also sort this list (before selecting your rows), by clicking on the header row.
Clicking on the left of the header row will highlight all the rows, to allow mass select/deselect. Ensure that you click on the LAST row in the selection group when doing this.

Updated Wiki: Home

kmartin — Sun, 21 Oct 2012 11:52:47 GMT

Creator: Keith Martin

Description: SSIS Multiple Hash makes it possible to generate many Hash values from each input row. Hash's supported include MD5 and SHA1.

Download:
The Default Download is for SQL Server 2012. If you are using SQL 2005, 2008 or 2008R2, then please select the appropriate download from the View All Downloads link to the right.

Design Page Example

Meta Data from Example

Main Project Site: http://ssismhash.codeplex.com/

Source Download: SSIS Multiple Hash on Codeplex, Source Code Tab
Binary Download: SSIS Multiple Hash on Codeplex, Releases Tab

Instructions: SSIS Multiple Hash Component Wiki

This component has now been updated to version 1.6.
This release corrects a bug in date time handling, where milliseconds were not being hashed. Updating the component will NOT automatically correct this in existing packages. You will have to tick the box Milliseconds to enable this. This has been done to preserve backwards compatability.

If you are not hashing Date Time data types with a requirement for millisecond precision, then you don't need to update your component version.

Version 1.5.1 Details:
This release improves performance significantly, and corrects a UI defect in multiple select.

Version 1.5 Details:
This release adds 4 new Hash algorithms, and corrects a defect in the multiple select capability.

Version 1.4.1 Details:
This release adds multiple select/deselect capability to the Input and Output tabs for the check box columns.

Version 1.4 Details:
This release improves the UI for selection of columns in the Hash, and the ordering of these columns.
It also includes SQL 2012 support.

Version 1.3.1 Details:
Corrects an issue with Multiple Threading and Thread Safe not being enabled.

Version 1.3 Details:
This release adds the ability to upgrade an SQL 2005 package to SQL 2008.
This release adds the ability to detect the following scenarios:

Version 1.2.1 or lessor

Col 1	Col 2	Col 3	Hash
Text	NULL	Text 2	0x123456
Text	Text 2	NULL	0x123456
NULL	Text	Text 2	0x123456

Version 1.3 without Safe Ticked (This is the default action on an update)

Col 1	Col 2	Col 3	Hash
Text	NULL	Text 2	0x123456
Text	Text 2	NULL	0x123456
NULL	Text	Text 2	0x123456

Version 1.3 with Safe Ticked (You have to enable this in your existing packages)

Col 1	Col 2	Col 3	Hash
Text	NULL	Text 2	0x123564
Text	Text 2	NULL	0x124563
NULL	Text	Text 2	0x823456

Updated Wiki: Home

kmartin — Thu, 24 May 2012 13:23:05 GMT

Col 1	Col 2	Col 3	Hash
Text	NULL	Text 2	0x123456
Text	Text 2	NULL	0x123456
NULL	Text	Text 2	0x123456

Version 1.3 without Safe Ticked (This is the default action on an update)

Col 1	Col 2	Col 3	Hash
Text	NULL	Text 2	0x123456
Text	Text 2	NULL	0x123456
NULL	Text	Text 2	0x123456

Version 1.3 with Safe Ticked (You have to enable this in your existing packages)

Col 1	Col 2	Col 3	Hash
Text	NULL	Text 2	0x123564
Text	Text 2	NULL	0x124563
NULL	Text	Text 2	0x823456

Updated Wiki: Documentation

kmartin — Wed, 11 Apr 2012 11:56:33 GMT

Usage Instructions

The following should assist you in using this component.

Installation

Add a data flow task into a new Integration Services package
Open the data flow task
Display the Toolbox
Right click the Data Flow Transformations within the Toolbox
Select Choose Items
Switch to the SSIS Data Flow Items tab
Tick the check box next to Multiple Hash in the list
Ok your way out of the dialog boxes

Inputs

The component needs a single input.

Outputs

The component generates a single output. This output will add new columns to your data flow that will be Binary data from the Hash functions.
The following Hash functions are supported:

Hash	Size
MD5	16
Ripe MD 160	20
SHA1	20
SHA256	32
SHA384	48
SHA512	64
CRC32	4
CRC32C	4
FNV1a 32	4
FNV1a 64	8

Configuration

Input Columns Tab
Output Columns Tab

Usage

To use, drop the component on the design surface.
Connect it to a Data Flow Source
Edit the component
Select the Input Columns Tab (should already be active)
Tick the columns that will be used for generation of the hash's. If planning more than one hash, then ensure that you select the columns for all hash's to be generated.
If you will have a large number of output columns, and will be excuting on a multi core machine, then consider enabling the Multiple Threading
1. None will not do Multiple Threading
2. Auto will do some basic checking, before enabling multiple threading (number of CPU's, and Number of Outputs)
3. On will enable multiple threading (regardless of the number of CPU Core's etc.
Switch to the Output Columns Tab
In the Output Columns list, enter a new column name, and then select the Hash function
The list to the right should now be populated with the columns that you selected on the Input Columns Tab.
Tick the columns that you wish to use for this Hash.
Repeat 8 though 10 until finished.
Add a Data Flow Destination
Connect the Output from the component to the Data Flow Destination
Run your SSIS component...

Updated Wiki: Home

kmartin — Wed, 11 Apr 2012 11:53:53 GMT

Col 1	Col 2	Col 3	Hash
Text	NULL	Text 2	0x123456
Text	Text 2	NULL	0x123456
NULL	Text	Text 2	0x123456

Version 1.3 without Safe Ticked (This is the default action on an update)

Col 1	Col 2	Col 3	Hash
Text	NULL	Text 2	0x123456
Text	Text 2	NULL	0x123456
NULL	Text	Text 2	0x123456

Version 1.3 with Safe Ticked (You have to enable this in your existing packages)

Col 1	Col 2	Col 3	Hash
Text	NULL	Text 2	0x123564
Text	Text 2	NULL	0x124563
NULL	Text	Text 2	0x823456

Updated Wiki: ConfigInputTab

kmartin — Fri, 23 Mar 2012 10:07:06 GMT

Input Columns Tab

This tab allows you to select which columns you want to be available to generate hash values.

Usage is as simple as ticking which columns you wish to use.

New in 1.4.1 is the ability to highlight a number of rows in the list, and select/deselect them as a group. Just ensure that you have the shift key pressed when you click in the checkbox at the bottom of your group selection.
You can also sort this list (before selecting your rows), by clicking on the header row.

The Safe Null Handling should be ticked...
This will ensure that the component will detect when a null and valued column next to each other swap data.
The Enable Multiple Threading drop down has three values:

Value	Meaning
None	Use a single thread to calculate all outputs
Auto	If more than 2 Cores, and more than 5 outputs, assign each output to a different thread
On	Assign each output to a different thread

Updated Wiki: ConfigOutputTab

kmartin — Fri, 23 Mar 2012 10:06:17 GMT

Output Columns Tab

This tab allows you to:

add new output columns
rename existing output columns
change the Hash function used on output columns
select which input columns are used for a hash
change the order of the input columns used for a hash

Usage

Updated Wiki: ConfigOutputTab

kmartin — Fri, 23 Mar 2012 10:05:07 GMT

Output Columns Tab

This tab allows you to:

add new output columns
rename existing output columns
change the Hash function used on output columns
select which input columns are used for a hash
change the order of the input columns used for a hash

Usage

Updated Wiki: Home

kmartin — Fri, 23 Mar 2012 10:03:00 GMT

Col 1	Col 2	Col 3	Hash
Text	NULL	Text 2	0x123456
Text	Text 2	NULL	0x123456
NULL	Text	Text 2	0x123456

Version 1.3 without Safe Ticked (This is the default action on an update)

Col 1	Col 2	Col 3	Hash
Text	NULL	Text 2	0x123456
Text	Text 2	NULL	0x123456
NULL	Text	Text 2	0x123456

Version 1.3 with Safe Ticked (You have to enable this in your existing packages)

Col 1	Col 2	Col 3	Hash
Text	NULL	Text 2	0x123564
Text	Text 2	NULL	0x124563
NULL	Text	Text 2	0x823456

Updated Wiki: Home

kmartin — Thu, 22 Mar 2012 23:15:45 GMT

Col 1	Col 2	Col 3	Hash
Text	NULL	Text 2	0x123456
Text	Text 2	NULL	0x123456
NULL	Text	Text 2	0x123456

Version 1.3 without Safe Ticked (This is the default action on an update)

Col 1	Col 2	Col 3	Hash
Text	NULL	Text 2	0x123456
Text	Text 2	NULL	0x123456
NULL	Text	Text 2	0x123456

Version 1.3 with Safe Ticked (You have to enable this in your existing packages)

Col 1	Col 2	Col 3	Hash
Text	NULL	Text 2	0x123564
Text	Text 2	NULL	0x124563
NULL	Text	Text 2	0x823456

Updated Wiki: ConfigOutputTab

kmartin — Sun, 25 Sep 2011 12:25:48 GMT

Output Columns Tab

This tab allows you to:

add new output columns
rename existing output columns
change the Hash function used on output columns
select which input columns are used for a hash
change the order of the input columns used for a hash

Usage

Updated Wiki: Documentation

kmartin — Sun, 25 Sep 2011 12:22:09 GMT

Usage Instructions

The following should assist you in using this component.

Installation

Add a data flow task into a new Integration Services package
Open the data flow task
Display the Toolbox
Right click the Data Flow Transformations within the Toolbox
Select Choose Items
Switch to the SSIS Data Flow Items tab
Tick the check box next to Multiple Hash in the list
Ok your way out of the dialog boxes

Inputs

The component needs a single input.

Outputs

The component generates a single output. This output will add new columns to your data flow that will be Binary data from the Hash functions.
The following Hash functions are supported:

Hash	Size
MD5	16
Ripe MD 160	20
SHA1	20
SHA256	32
SHA384	48
SHA512	64

Configuration

Input Columns Tab
Output Columns Tab

Usage

To use, drop the component on the design surface.
Connect it to a Data Flow Source
Edit the component
Select the Input Columns Tab (should already be active)
Tick the columns that will be used for generation of the hash's. If planning more than one hash, then ensure that you select the columns for all hash's to be generated.
If you will have a large number of output columns, and will be excuting on a multi core machine, then consider enabling the Multiple Threading
1. None will not do Multiple Threading
2. Auto will do some basic checking, before enabling multiple threading (number of CPU's, and Number of Outputs)
3. On will enable multiple threading (regardless of the number of CPU Core's etc.
Switch to the Output Columns Tab
In the Output Columns list, enter a new column name, and then select the Hash function
The list to the right should now be populated with the columns that you selected on the Input Columns Tab.
Tick the columns that you wish to use for this Hash.
Repeat 8 though 10 until finished.
Add a Data Flow Destination
Connect the Output from the component to the Data Flow Destination
Run your SSIS component...

Updated Wiki: Home

kmartin — Sun, 25 Sep 2011 12:21:24 GMT

Creator: Keith Martin

Description: SSIS Multiple Hash makes it possible to generate many Hash values from each input row. Hash's supported include MD5 and SHA1.

Design Page Example

Meta Data from Example

Main Project Site: http://ssismhash.codeplex.com/

Source Download: SSIS Multiple Hash on Codeplex, Source Code Tab
Binary Download: SSIS Multiple Hash on Codeplex, Releases Tab

Instructions: SSIS Multiple Hash Component Wiki

This component has now been updated to version 1.4
This release improves the UI for selection of columns in the Hash, and the ordering of these columns.
It also includes Denali support.

Version 1.3.1 Details:
Corrects an issue with Multiple Threading and Thread Safe not being enabled.

Version 1.3 Details:
This release adds the ability to upgrade an SQL 2005 package to SQL 2008.
This release adds the ability to detect the following scenarios:

Version 1.2.1 or lessor

Col 1	Col 2	Col 3	Hash
Text	NULL	Text 2	0x123456
Text	Text 2	NULL	0x123456
NULL	Text	Text 2	0x123456

Version 1.3 without Safe Ticked (This is the default action on an update)

Col 1	Col 2	Col 3	Hash
Text	NULL	Text 2	0x123456
Text	Text 2	NULL	0x123456
NULL	Text	Text 2	0x123456

Version 1.3 with Safe Ticked (You have to enable this in your existing packages)

Col 1	Col 2	Col 3	Hash
Text	NULL	Text 2	0x123564
Text	Text 2	NULL	0x124563
NULL	Text	Text 2	0x823456

Updated Wiki: Home

kmartin — Fri, 20 May 2011 12:31:24 GMT

Creator: Keith Martin

Description: SSIS Multiple Hash makes it possible to generate many Hash values from each input row. Hash's supported include MD5 and SHA1.

Design Page Example

Meta Data from Example

Main Project Site: http://ssismhash.codeplex.com/

Source Download: SSIS Multiple Hash on Codeplex, Source Code Tab
Binary Download: SSIS Multiple Hash on Codeplex, Releases Tab

Instructions: SSIS Multiple Hash Component Wiki

This component has now been updated to version 1.3.1
(This is release corrects and issue with Multiple Threading and Thread Safe not being enabled).

Version 1.3 Details:
This release adds the ability to upgrade an SQL 2005 package to SQL 2008.
This release adds the ability to detect the following scenarios:

Version 1.2.1 or lessor

Col 1	Col 2	Col 3	Hash
Text	NULL	Text 2	0x123456
Text	Text 2	NULL	0x123456
NULL	Text	Text 2	0x123456

Version 1.3 without Safe Ticked (This is the default action on an update)

Col 1	Col 2	Col 3	Hash
Text	NULL	Text 2	0x123456
Text	Text 2	NULL	0x123456
NULL	Text	Text 2	0x123456

Version 1.3 with Safe Ticked (You have to enable this in your existing packages)

Col 1	Col 2	Col 3	Hash
Text	NULL	Text 2	0x123564
Text	Text 2	NULL	0x124563
NULL	Text	Text 2	0x823456

Updated Wiki: Home

kmartin — Wed, 13 Oct 2010 12:59:03 GMT

Creator: Keith Martin

Description: SSIS Multiple Hash makes it possible to generate many Hash values from each input row. Hash's supported include MD5 and SHA1.

Design Page Example

Meta Data from Example

Main Project Site: http://ssismhash.codeplex.com/

Source Download: SSIS Multiple Hash on Codeplex, Source Code Tab
Binary Download: SSIS Multiple Hash on Codeplex, Releases Tab

Instructions: SSIS Multiple Hash Component Wiki

This component has now been updated to version 1.3
This release adds the ability to upgrade an SQL 2005 package to SQL 2008.
This release adds the ability to detect the following scenarios:

Version 1.2.1 or lessor

Col 1	Col 2	Col 3	Hash
Text	NULL	Text 2	0x123456
Text	Text 2	NULL	0x123456
NULL	Text	Text 2	0x123456

Version 1.3 without Safe Ticked (This is the default action on an update)

Col 1	Col 2	Col 3	Hash
Text	NULL	Text 2	0x123456
Text	Text 2	NULL	0x123456
NULL	Text	Text 2	0x123456

Version 1.3 with Safe Ticked (You have to enable this in your existing packages)

Col 1	Col 2	Col 3	Hash
Text	NULL	Text 2	0x123564
Text	Text 2	NULL	0x124563
NULL	Text	Text 2	0x823456

Updated Wiki: Documentation

kmartin — Wed, 13 Oct 2010 12:48:23 GMT

Usage Instructions

The following should assist you in using this component.

Installation

After downloading the appropriate setup files, unzip them, and execute the Setup.exe file.

If you have a previous version (1.0, 1.1, 1.2, or 1.2.1) you will get a dialog box informing you that you must uninstall the previous version.
Do this, and then restart the installation.

Once the installation has completed, you will need to start BIDS, and add the new component into the Toolbox.
This is done as follows:

Add a data flow task into a new Integration Services package
Open the data flow task
Display the Toolbox
Right click the Data Flow Transformations within the Toolbox
Select Choose Items
Switch to the SSIS Data Flow Items tab
Tick the check box next to Multiple Hash in the list
Ok your way out of the dialog boxes

Inputs

The component needs a single input.

Outputs

The component generates a single output. This output will add new columns to your data flow that will be Binary data from the Hash functions.
The following Hash functions are supported:

Hash	Size
MD5	16
Ripe MD 160	20
SHA1	20
SHA256	32
SHA384	48
SHA512	64

Configuration

Input Columns Tab
Output Columns Tab

Usage

To use, drop the component on the design surface.
Connect it to a Data Flow Source
Edit the component
Select the Input Columns Tab (should already be active)
Tick the columns that will be used for generation of the hash's. If planning more than one hash, then ensure that you select the columns for all hash's to be generated.
If you will have a large number of output columns, and will be excuting on a multi core machine, then consider enabling the Multiple Threading
1. None will not do Multiple Threading
2. Auto will do some basic checking, before enabling multiple threading (number of CPU's, and Number of Outputs)
3. On will enable multiple threading (regardless of the number of CPU Core's etc.
Switch to the Output Columns Tab
In the Output Columns list, enter a new column name, and then select the Hash function
The list to the right should now be populated with the columns that you selected on the Input Columns Tab.
Tick the columns that you wish to use for this Hash.
Repeat 8 though 10 until finished.
Add a Data Flow Destination
Connect the Output from the component to the Data Flow Destination
Run your SSIS component...