Microsoft SQL Server Metadata-Driven ETL Management Studio (MDDE)

New Post: Step by Step Instructions

mmasson — Fri, 13 Jun 2008 17:40:54 GMT

I've added a quick walkthrough on my blog. It covers basic package generation - I plan to show some data flow examples (once I figure it all out).

New Post: Object reference not set to an instance of an object

shoeff — Thu, 12 Jun 2008 07:53:24 GMT

Script component removed and still got the error messsage

Your lines addad an still got the error message

Edit an executing the package should be done in BIDS. or is that an incorrect understanding of your question?

New Post: Step by Step Instructions

shoeff — Thu, 12 Jun 2008 07:51:22 GMT

This is as far a I understand it

Create template package (or use the delivered one)
Import the template package.
During the import mark which parameters you want to configure
create a new instance an fill the parameters
generate the packages

NEW POST: Step by Step Instructions

gooch — Mon, 09 Jun 2008 19:45:04 GMT

Is there a step by step instruction doc for this tool?

Thanks

Gooch

NEW POST: Object reference not set to an instance of an object

quan_ca — Wed, 16 Apr 2008 23:28:49 GMT

Made a little modification of changing the componentClassName and able to get my package imported.

MDDEComponentFactory.cs
public static MDDEComponent CreateInstance(...)

if (componentClassName == "DTS.Pipeline")
componentClassName = "DTS.Pipeline.1";

Next questions are how do I edit and execute my package?

NEW POST: Object reference not set to an instance of an object

kskistad — Tue, 15 Apr 2008 17:58:58 GMT

Update:

I debugged the code and it turns out the a script task is not a valid component type for a template

NEW POST: Object reference not set to an instance of an object

kskistad — Mon, 14 Apr 2008 15:06:52 GMT

When I try to import a template, I get the error. It doesn't happen if the package is empty, only when it is an existing SSIS package.

-Kory

See the end of this message for details on invoking
just-in-time (JIT) debugging instead of this dialog box.

Exception Text **************

System.NullReferenceException: Object reference not set to an instance of an object.
at Microsoft.SharedSource.SqlServer.MDDE.ManagementStudio.ImportTemplate.LoadTemplate() in C:\Users\davidree\Documents\Visual Studio 2005\Projects\Microsoft.SharedSource.SqlServer.MDDE.Studio\ManagementStudio\ImportTemplate.cs:line 305
at Microsoft.SharedSource.SqlServer.MDDE.ManagementStudio.ImportTemplate.CheckForValidInputsAndLoadTemplate() in C:\Users\davidree\Documents\Visual Studio 2005\Projects\Microsoft.SharedSource.SqlServer.MDDE.Studio\ManagementStudio\ImportTemplate.cs:line 285
at Microsoft.SharedSource.SqlServer.MDDE.ManagementStudio.ImportTemplate.btnBrowse_Click(Object sender, EventArgs e) in C:\Users\davidree\Documents\Visual Studio 2005\Projects\Microsoft.SharedSource.SqlServer.MDDE.Studio\ManagementStudio\ImportTemplate.cs:line 53
at System.Windows.Forms.Control.OnClick(EventArgs e)
at System.Windows.Forms.Button.OnClick(EventArgs e)
at System.Windows.Forms.Button.OnMouseUp(MouseEventArgs mevent)
at System.Windows.Forms.Control.WmMouseUp(Message& m, MouseButtons button, Int32 clicks)
at System.Windows.Forms.Control.WndProc(Message& m)
at System.Windows.Forms.ButtonBase.WndProc(Message& m)
at System.Windows.Forms.Button.WndProc(Message& m)
at System.Windows.Forms.Control.ControlNativeWindow.OnMessage(Message& m)
at System.Windows.Forms.Control.ControlNativeWindow.WndProc(Message& m)
at System.Windows.Forms.NativeWindow.Callback(IntPtr hWnd, Int32 msg, IntPtr wparam, IntPtr lparam)

Loaded Assemblies **************

mscorlib
Assembly Version: 2.0.0.0
Win32 Version: 2.0.50727.1378 (REDBITSB2.050727-1300)
CodeBase: file:///C:/WINDOWS/Microsoft.NET/Framework/v2.0.50727/mscorlib.dll
----------------------------------------
Microsoft.SharedSource.SqlServer.MDDE.ManagementStudio
Assembly Version: 1.0.0.0
Win32 Version: 1.0.0.0
CodeBase: file:///C:/Program%20Files/Microsoft%20SQL%20Server%20Community/Microsoft%20SQL%20Server%20Metadata-Driven%20ETL%20Management%20Studio%20(x86)/Microsoft.SharedSource.SqlServer.MDDE.ManagementStudio.exe
----------------------------------------
System.Windows.Forms
Assembly Version: 2.0.0.0
Win32 Version: 2.0.50727.1378 (REDBITSB2.050727-1300)
CodeBase: file:///C:/WINDOWS/assembly/GACMSIL/System.Windows.Forms/2.0.0.0_b77a5c561934e089/System.Windows.Forms.dll
----------------------------------------
System
Assembly Version: 2.0.0.0
Win32 Version: 2.0.50727.1378 (REDBITSB2.050727-1300)
CodeBase: file:///C:/WINDOWS/assembly/GACMSIL/System/2.0.0.0_b77a5c561934e089/System.dll
----------------------------------------
System.Drawing
Assembly Version: 2.0.0.0
Win32 Version: 2.0.50727.1378 (REDBITSB2.050727-1300)
CodeBase: file:///C:/WINDOWS/assembly/GACMSIL/System.Drawing/2.0.0.0_b03f5f7f11d50a3a/System.Drawing.dll
----------------------------------------
System.Xml
Assembly Version: 2.0.0.0
Win32 Version: 2.0.50727.1378 (REDBITSB2.050727-1300)
CodeBase: file:///C:/WINDOWS/assembly/GACMSIL/System.Xml/2.0.0.0_b77a5c561934e089/System.Xml.dll
----------------------------------------
System.Configuration
Assembly Version: 2.0.0.0
Win32 Version: 2.0.50727.1378 (REDBITSB2.050727-1300)
CodeBase: file:///C:/WINDOWS/assembly/GACMSIL/System.Configuration/2.0.0.0_b03f5f7f11d50a3a/System.Configuration.dll
----------------------------------------
System.Data
Assembly Version: 2.0.0.0
Win32 Version: 2.0.50727.1378 (REDBITSB2.050727-1300)
CodeBase: file:///C:/WINDOWS/assembly/GAC32/System.Data/2.0.0.0_b77a5c561934e089/System.Data.dll
----------------------------------------
Microsoft.SqlServer.Smo
Assembly Version: 9.0.242.0
Win32 Version: 9.00.3042.00
CodeBase: file:///C:/WINDOWS/assembly/GACMSIL/Microsoft.SqlServer.Smo/9.0.242.0_89845dcd8080cc91/Microsoft.SqlServer.Smo.dll
----------------------------------------
Microsoft.SqlServer.SmoEnum
Assembly Version: 9.0.242.0
Win32 Version: 9.00.3042.00
CodeBase: file:///C:/WINDOWS/assembly/GACMSIL/Microsoft.SqlServer.SmoEnum/9.0.242.0_89845dcd8080cc91/Microsoft.SqlServer.SmoEnum.dll
----------------------------------------
Microsoft.SqlServer.ConnectionInfo
Assembly Version: 9.0.242.0
Win32 Version: 9.00.3042.00
CodeBase: file:///C:/WINDOWS/assembly/GACMSIL/Microsoft.SqlServer.ConnectionInfo/9.0.242.0_89845dcd8080cc91/Microsoft.SqlServer.ConnectionInfo.dll
----------------------------------------
Microsoft.SqlServer.SqlEnum
Assembly Version: 9.0.242.0
Win32 Version: 9.00.3042.00
CodeBase: file:///C:/WINDOWS/assembly/GACMSIL/Microsoft.SqlServer.SqlEnum/9.0.242.0_89845dcd8080cc91/Microsoft.SqlServer.SqlEnum.dll
----------------------------------------
Microsoft.SharedSource.SqlServer.MDDE.Repository
Assembly Version: 1.0.0.0
Win32 Version: 1.0.0.0
CodeBase: file:///C:/Program%20Files/Microsoft%20SQL%20Server%20Community/Microsoft%20SQL%20Server%20Metadata-Driven%20ETL%20Management%20Studio%20(x86)/Microsoft.SharedSource.SqlServer.MDDE.Repository.DLL
----------------------------------------
System.Transactions
Assembly Version: 2.0.0.0
Win32 Version: 2.0.50727.1378 (REDBITSB2.050727-1300)
CodeBase: file:///C:/WINDOWS/assembly/GAC32/System.Transactions/2.0.0.0_b77a5c561934e089/System.Transactions.dll
----------------------------------------
System.EnterpriseServices
Assembly Version: 2.0.0.0
Win32 Version: 2.0.50727.1378 (REDBITSB2.050727-1300)
CodeBase: file:///C:/WINDOWS/assembly/GAC32/System.EnterpriseServices/2.0.0.0_b03f5f7f11d50a3a/System.EnterpriseServices.dll
----------------------------------------
Microsoft.SharedSource.SqlServer.MDDE.Middleware
Assembly Version: 1.0.0.0
Win32 Version: 1.0.0.0
CodeBase: file:///C:/Program%20Files/Microsoft%20SQL%20Server%20Community/Microsoft%20SQL%20Server%20Metadata-Driven%20ETL%20Management%20Studio%20(x86)/Microsoft.SharedSource.SqlServer.MDDE.Middleware.DLL
----------------------------------------
Microsoft.SqlServer.ManagedDTS
Assembly Version: 9.0.242.0
Win32 Version: 9.00.3042.00
CodeBase: file:///C:/WINDOWS/assembly/GACMSIL/Microsoft.SqlServer.ManagedDTS/9.0.242.0_89845dcd8080cc91/Microsoft.SqlServer.ManagedDTS.dll
----------------------------------------
Microsoft.SqlServer.DTSRuntimeWrap
Assembly Version: 9.0.242.0
Win32 Version: 9.0.242.0
CodeBase: file:///C:/WINDOWS/assembly/GAC32/Microsoft.SqlServer.DTSRuntimeWrap/9.0.242.0_89845dcd8080cc91/Microsoft.SqlServer.DTSRuntimeWrap.dll
----------------------------------------
Microsoft.SqlServer.SQLTask
Assembly Version: 9.0.242.0
Win32 Version: 9.00.3042.00
CodeBase: file:///C:/WINDOWS/assembly/GAC32/Microsoft.SqlServer.SQLTask/9.0.242.0_89845dcd8080cc91/Microsoft.SqlServer.SQLTask.dll
----------------------------------------
Microsoft.SqlServer.msxml6_interop
Assembly Version: 6.0.0.0
Win32 Version: 6.0.0.0
CodeBase: file:///C:/WINDOWS/assembly/GACMSIL/Microsoft.SqlServer.msxml6interop/6.0.0.0_89845dcd8080cc91/Microsoft.SqlServer.msxml6interop.dll
----------------------------------------
Microsoft.SharedSource.SqlServer.MDDE.Components
Assembly Version: 1.0.0.0
Win32 Version: 1.0.0.0
CodeBase: file:///C:/Program%20Files/Microsoft%20SQL%20Server%20Community/Microsoft%20SQL%20Server%20Metadata-Driven%20ETL%20Management%20Studio%20(x86)/Microsoft.SharedSource.SqlServer.MDDE.Components.DLL
----------------------------------------
CustomMarshalers
Assembly Version: 2.0.0.0
Win32 Version: 2.0.50727.1378 (REDBITSB2.050727-1300)
CodeBase: file:///C:/WINDOWS/assembly/GAC32/CustomMarshalers/2.0.0.0_b03f5f7f11d50a3a/CustomMarshalers.dll
----------------------------------------
Microsoft.SqlServer.DTSPipelineWrap
Assembly Version: 9.0.242.0
Win32 Version: 9.0.242.0
CodeBase: file:///C:/WINDOWS/assembly/GACMSIL/Microsoft.SqlServer.DTSPipelineWrap/9.0.242.0_89845dcd8080cc91/Microsoft.SqlServer.DTSPipelineWrap.dll
----------------------------------------

JIT Debugging **************

To enable just-in-time (JIT) debugging, the .config file for this
application or computer (machine.config) must have the
jitDebugging value set in the system.windows.forms section.
The application must also be compiled with debugging
enabled.

For example:

<configuration>
<system.windows.forms jitDebugging="true" />
</configuration>

When JIT debugging is enabled, any unhandled exception
will be sent to the JIT debugger registered on the computer
rather than be handled by this dialog box.

NEW POST: Should we use the default (only) template in the zip folder?

ReedMe — Mon, 07 Apr 2008 23:04:58 GMT

sundanceca wrote:
Should we use the default (only) template in the zip folder when 'loading' a template into the enterprise.exe?

You'll be much better off using the Beta 0 release today than the source ZIP that you snagged earlier, 'chief.

UPDATED WIKI: Home

ReedMe — Mon, 07 Apr 2008 23:00:37 GMT

Project Description
Originally an internal MSIT solution that has been released as an open source project, the Microsoft SQL Server Metadata-Driven ETL Management Studio (a.k.a. MDDE) provides a tool for rapidly generating SQL Server Integration Services (SSIS) packages from a shared central metadata repository. MDDE is a software factory for SSIS packages that leverages the SSIS API to provide a templating engine that accelerates ETL development.

Note: The pre-release source code has been checked into TFS, and is under active development toward a v1.0, community-ready state.

Prerequisites

Either the MSI installer from an MDDE release installed or the solution code already built in Visual Studio 2005 to run in debug mode.
An instance of Microsoft SQL Server 2005 database engine to install the repository to (may be local or remote).
Microsoft SQL Server 2005 Integration Services must be installed on the target workstation.
Microsoft BIDS is required for creating and maintaining package templates as well as debugging them.

Note: The code is currently compiled only against SQL Server 2005. SQL Server 2008 packages have not yet been tested thoroughly with MDDE.

Usage
After installing MDDE using the MSI:

Create the MDDE database using the "Microsoft SQL Server MDDE Studio Schema.sql" script that is installed along with the other program files. Warning: This script must be executed using SQLCMD mode.

Double-click the desktop shortcut or use the shortcut in All Programs|Microsoft SQL Server MDDE Studio|SQL Server MDDE Management Studio to launch MDDE.
Use the connect button in the toolbar to connect to the server\instance where you created the MDDE repository.

Import a template from either a sample package or one that you've created to get started by right-clicking on the Templates node in the tree view.

Note: Additional documentation to follow.

Templates
TBD

Samples
TBD

Roadmap
TBD

CREATED RELEASE: v1.0 Beta 0 (Apr 07, 2008)

Mon, 07 Apr 2008 17:33:03 GMT

MDDE is very much a work in progress; however, we would very much like your constructive feedback through the discussions and/or the issue tracker.

UPDATED WIKI: Home

ReedMe — Mon, 07 Apr 2008 17:29:13 GMT

Either the MSI installer from an MDDE release installed or the solution code already built in Visual Studio 2005 to run in debug mode.
An instance of Microsoft SQL Server 2005 database engine to install the repository to (may be local or remote).
Microsoft SQL Server 2005 Integration Services must be installed on the target workstation.
Microsoft BIDS is required for creating and maintaining package templates as well as debugging them.

Note: The code is currently compiled only against SQL Server 2005. SQL Server 2008 packages have not yet been tested thoroughly with MDDE.

Usage
After installing MDDE using the MSI:

Create the MDDE database using the "Microsoft SQL Server MDDE Studio Schema.sql" script that is installed along with the other program files. Warning: This script must be executed using SQLCMD mode.

Double-click the desktop shortcut or use the shortcut in All Programs|Microsoft SQL Server MDDE Studio|SQL Server MDDE Management Studio to launch MDDE.
Use the connect button in the toolbar to connect to the server\instance where you created the MDDE repository.

Import a template from either a sample package or one that you've created to get started by right-clicking on the Templates node in the tree view.

Note: Additional documentation to follow.

Source code checked in

ReedMe — Mon, 07 Apr 2008 16:36:27 GMT

Working check-in for installer/setup utility. Pre-release v1.0.

NEW POST: Should we use the default (only) template in the zip folder?

sundanceca — Thu, 20 Mar 2008 00:37:29 GMT

Should we use the default (only) template in the zip folder when 'loading' a template into the enterprise.exe?

Source code checked in

ReedMe — Wed, 19 Mar 2008 23:57:03 GMT

Initial pre-release check-in.

UPDATED WIKI: Home

ReedMe — Wed, 19 Mar 2008 23:56:41 GMT

Project Description
Originally an MSIT project, the SQL Server Metadata-Driven ETL Studio provides a tool for rapidly generating SQL Server Integration Services packages from a central metadata repository.

Note: The pre-release source code has been checked into TFS, and is under active development toward a v1.0, community-ready state.

UPDATED WIKI: Home

ReedMe — Wed, 19 Mar 2008 23:56:24 GMT

Project Description
Originally an MSIT project, the SQL Server Metadata-Driven ETL Studio provides a tool for rapidly generating SQL Server Integration Services packages from a central metadata repository.

**Delete the following note before publishing **

Note: The pre-release source code has been checked into TFS, and is under active development toward a v1.0, community-ready state.