what is WebsiteSpark?

WebsiteSpark is designed for independent web developers and web development companies that build web applications and web sites on behalf of others.  It enables you to get software, support and business resources from Microsoft at no cost for three years, and enables you to expand your business and build great web solutions using ASP.NET, Silverlight, SharePoint and PHP, and the open source applications built on top of them.

What does the program provide?

WebSiteSpark provides software licenses that you can use for three years at no cost.  Once enrolled, you can download and immediately use the following software from Microsoft:

• 3 licenses of Visual Studio 2008 Professional Edition
• 1 license of Expression Studio 3 (which includes Expression Blend, Sketchflow, and Web)
• 2 licenses of Expression Web 3
• 4 processor licenses of Windows Web Server 2008 R2
• 4 processor licenses of SQL Server 2008 Web Edition
• DotNetPanel control panel (enabling easy remote/hosted management of your servers)

The Windows Server and SQL Server licenses can be used for both development and production deployment.  You can either self-host the servers on your own, or use the licenses with a hoster.  WebsiteSpark makes it easy to find hosters who are also enrolled in the program, and who can use your licenses to provide you with either dedicated or virtual dedicated servers to host your sites on.

In addition to software, WebsiteSpark provides partner opportunities to grow and build your business (including customer referrals through our partner programs).  It also includes product support (including 2 professional support incidents) and free online training for the products.

for further information on this visit Scotts blog here.

Thanks Scott for the great information .

Lets get back to business, its been a long time since my last post, as usual busy schedules (i know, i know i tell this often !), but all these days i had several bits and pieces on queue for my blog, and here i am with that.

Last week i had an early morning call from Administrators of  Catalogues4u.com.au. they said that the website is running very slow, and users are having connection timeouts in their browsers or poor performance, server logs are filled with SQLConnection Timeout. they have been receiving calls, complaints from their top management, and most of all server restarts. horrible isn’t it?  they have checked the server, and the CPU was running almost 100%, and the culprit which used the most of the CPU was SQL Server.

After spending time in logs, and SQL profiler runs, i found that one stored procedure was taking more time to execute than the others.

here is a part of that SP:

SELECT  DISTINCT c.ENDDATE,c.ID, c.NAME,c.THUMBNAILURL,c.CONTENSDESCRIPTION
INTO #temp
FROM GW_CATELOGUE c
 INNER JOIN dbo.GW_CATELOGUE_POSTCODES cp
  ON c.ID=cp.CATELOGUEID
 INNER JOIN dbo.GW_POSTCODES p ON p.Id=cp.POSTCODEID
WHERE  p.POSTCODE=@postcode
 AND (ENDDATE BETWEEN getDate() AND DATEADD(dd, 7, getDate()))
 AND (STARTDATE <= getDate())
 AND (ENDDATE >= getDate())
 AND c.APPROVED=1 ORDER BY c.ENDDATE

There were some other SP’s with same structure except the  below Date Filtering which were running perfectly alright:

AND (ENDDATE BETWEEN getDate() AND DATEADD(dd, 7, getDate()))

AND (STARTDATE <= getDate()) AND (ENDDATE >= getDate())

Well This made me thing something is fishy with the date. with confused mind, and help of MVP Dinesh Priyangara I Created 4 Non- Clustered Indexes on Catalogue_STARTDATE, Catalogue_ENDDATE and POSTCODE:

CREATE INDEX Catalogue_STARTDATE ON GW_CATELOGUE(STARTDATE)
CREATE INDEX Catalogue_ENDDATE ON GW_CATELOGUE(ENDDATE)
CREATE INDEX PostCodes_POSTCODE ON GW_POSTCODES(POSTCODE)

And Bang!! it worked. server  was back to normal, and everyone was happy. well this might not be a big deal, but still as somebody said, information is wealth!!.

Assume that we need to upload a file  and save its name, and the file in the database table. so lets see how we do it.

This is my Table

CREATE TABLE [dbo].[Files2](
    [ID] [int] IDENTITY(1,1) NOT NULL,
    [FileName] [varchar](50) NOT NULL,
    [FileSource] [image] NOT NULL,
 )
GO

And The Following Stored Procedure is used to Insert the Value:

CREATE PROCEDURE [dbo].[ADDFILE]
(
    @FILENAME VARCHAR(50),
    @FILESOURCE image
)
AS
SET NOCOUNT ON

INSERT INTO Files([FileName],[FileSource])
VALUES(@FILENAME,@FILESOURCE)

And the following code is used to upload and save the file using web form with a text box for file name, and a file upload control to upload the file. on the click event of a button this code is called.

protected void Button1_Click(object sender, EventArgs e)
{

     if (FileUploader.HasFile && FileUploader.PostedFile.ContentLength > 0)
      {
          string filename = txtFileName.Text;
          //Read the file in to a byte Array.
          byte[] filebyte = FileUploader.FileBytes;

    System.Data.Linq.Binary fileBinary = new System.Data.Linq.Binary(filebyte);
          MyDataDataContext MyData = new MyDataDataContext();

          MyData.ADDFILE(filename, fileBinary);
          lblStatus.Text = "File Uploaded Successfully!";

        }
}

The Main thing to remember here is that we need to pass the FileUploader.FileBytes  to the constructor of System.Data.Linq.Binary.

To Learn more about LINQ to SQL Please visit Here.

 EDIT: Richie just showed another way to achieve this in his blog here.

Well the current project which im working on is the ASSETTE Presentations. for more information on the project you can see the above link. but the project uses alot of binary data transfered back and forth to the server and the client thorugh our web services, and most of these binary files are stored in SQL Server 2005 Database. storing binary files inside the database really slows down retrieval of the files when we need them and there are several other desadvantages also. specially  rapidly growing size of the database,taking backups, and maintainance of the database. 

But now with SQL Server 2008 we have a new data type called FILESTREAM , to solve all the above issues.

What is FILESTREAM?

FILESTREAM is a new datatype in SQL SERVER 2008. To use FILESTREAM, a database needs to contain a FILESTREAM filegroup and a table which contains a varbinary(max) column with the FILESTREAM attribute set. This causes the Database Engine to store all data for that column in the file system, but not in the database file. A FILESTREAM filegroup is a special folder that contains file system directories known as data containers. These data containers are the interface between Database Engine storage and file system storage through which files in these data containers are maintained by Database Engine.

What FILESTREAM does?

By creating a FILESTREAM filegroup and setting a FILESTREAM attribute on the column of a table, a data container is created which will take care of DML statements.

FILESTREAM will use Windows API for streaming the files so that files can be accessed faster. Also instead of using SQL SERVER cache it will use Windows cache for caching the files accessed.

When you use FILESTREAM storage, consider the following:

• When a table contains a FILESTREAM column, each row must have a unique row ID.
• FILESTREAM data containers cannot be nested.
• When you are using failover clustering, the FILESTREAM filegroups must be on shared disk resources.
• FILESTREAM filegroups can be on compressed volumes.

And I was trying out visual studio 2008 and SQL server 2008 these days. And last night I found out that SQL server now support Tabled valued Parameters which allow us to send data tables as parameters to stored procedures. It still uses the same ADO.Net API.

Now I’m going to show how it works. For this I’m using the same scenario which I used in my previous post (reading contents of a folder and saving their information). here i have used sql server 2008 november ctp and visual c# 2008 express edition.

First create the table given below:

CREATE TABLE FileDetails(
FileName varchar(50) PRIMARY KEY,
CreatedDate varchar(50) ,
Size decimal(18, 0) )

Then, we should declare a new Table User Defined Type in the database:

create type FileDetailsType as table
(
FileName varchar(50),
CreatedDate varchar(50),
Size decimal(18,0)
)

Then create a stored procedure that gets a parameter of the above type, and inserts many rows in a single command.

create procedure InsertFileDetails
(
@FileDetails FileDetailsType readonly
)
as

insert
into FileDetails (FileName, CreatedDate, Size)
select FileName, CreatedDate, Size
from @FileDetails;

Then to execute this procedure, we can create a data table and add the rows in to it. And then pass this data table as parameter to the database.

private static void SaveFileDetail(List<FileInfo> info)

{

Console.WriteLine(“**********updating with tablevalued parameters****”);

DataTable dt = preparedatatable();

foreach (FileInfo file in info)

{

DataRow dr = dt.NewRow();

dr[0] = file.Name;

dr[1] = file.CreationTime.ToShortDateString();

dr[2] = (decimal)file.Length;

dt.Rows.Add(dr);

}

using (SqlConnection conn = new SqlConnection(“your connection string”))

{

SqlCommand cmd = conn.CreateCommand();

cmd.CommandType = System.Data.CommandType.StoredProcedure;

cmd.CommandText = “dbo.InsertFileDetails”;

SqlParameter param = cmd.Parameters.AddWithValue(“@FileDetails”, dt);

conn.Open();

cmd.ExecuteNonQuery();

Console.WriteLine(“Completed Updating the database”);

}

Now that’s cool isn’t it????

Download the code

And few more minutes of research I found out how to perform bulk operations against the databases using OPENXML and stored procedures.

What is OPENXML?

OPENXML is a function added to SQL Server 2000 that provides a row set view over an XML document. Since a row set is simply a set of rows that contain columns of data, OPENXML is the function that allows an XML document to be treated in the familiar relational database format. It allows for the passing of an XML document to a T-SQL stored procedure for updating the data.

OPENXML- Summery

• It extends the SQL Language
• It is used within T-SQL Stored Procedures
  • XML Document passed as parameter
• It uses row and column selectors utilizing XPath
• It supports the following:
  • Attribute and element-centric mappings.
  • Edge table row set.
  • XML annotation/overflow column.
  • Hierarchy support.

OPENXML and ADO.Net

This code block explains the usage of OPENXML to insert bulk data to database. It simulates the actual process I wanted ( processing .eml files) by reading files in a folder and saving their names, created date and size in bytes.

1. First create the table below:
   

   CREATE TABLE FileDetails(

   FileName varchar(50) PRIMARY KEY,

   CreatedDate varchar(50) ,

   Size decimal(18, 0) )

2. And then create the stored procedure below:
   

   CREATE PROC sp_bulkinsert @xmldata varchar(max)

   AS

   DECLARE @hDoc int

   exec sp_xml_preparedocument @hDoc OUTPUT,@xmldata

   –inserting data

   Insert Into FileDetails

   SELECT FileName, CreatedDate, Size

   FROM OPENXML (@hdoc, ‘/ds/fileDetails’,2)

   WITH (FileName varchar(50), CreatedDate Datetime, Size decimal) XMLFileDetails

   Where XMLFileDetails.FileName Not IN (Select FileName from FileDetails)

   EXEC sp_xml_removedocument @hDoc

   GO

3. The below sample code snippet shows how to call this stored procedure to insert bulk data to database at once.

We can retrieve the file details using FileInfo() objects and create a Dataset of the file details and then we can convert this Dataset to xml using WriteXml() Method of the Dataset.

private static string preparexml(DataSet ds)

{

StringBuilder sb = new StringBuilder();

StringWriter sw = new StringWriter(sb);

ds.WriteXml(sw, XmlWriteMode.WriteSchema);

return sb.ToString();

}

This xml representation of the data can be passed as the parameter to the stored procedure as given below :

private static void bulkInsert(string xml)

{

try{

SqlConnection con = creatCon();

con.Open();

SqlCommand cmd = new SqlCommand(“sp_bulkinsert”, con);

cmd.CommandType = CommandType.StoredProcedure;

cmd.Parameters.Add(new SqlParameter(“@xmldata”,SqlDbType.VarChar));

cmd.Parameters["@xmldata"].Value=xml;

cmd.ExecuteNonQuery();

Console.WriteLine(“Completed inserting file informations to database”);

con.Close();

}

catch(Exception ex)

{

Console.WriteLine(ex.Message);

}

}

That’s all simple isn’t it? You can see the performance of this method by writing another code to insert the same fields using the traditional 1 at a time way. Which surprisingly will show a huge difference in performance and time.

You can use the same way to update, delete records in bulk.

The complete code can be downloaded and tested in the below link :

Complete Source Code