Archive

Author Archive

Gartner Magic Quadrant BI and Analytics

February 18, 2017 Leave a comment

It is very interesting to see a consistent growth of Microsoft in BI and Analytics environment. Lets see Gartner’s Magic Quadrant BI and Analytics graph so several years.

2013

2013_mq

2014

2014_mq

2015

2015_mq

2016

2016_MQ.png

2017

2017_mq

We will revisit next year to see what-else has changed. By the way, what is your favorite tool.

Categories: Application, SQL Server, Tools

Can you identify file type without extension

November 17, 2016 Leave a comment

We may come across this situation when we get a file with out extension or given incorrectly. But, we have options in some operating system that will search and match the program associated with the unknown file type.

I had situation recently, a file with incorrect extension. I was trying to open the file in text edition (binary mode) to identify the file type manually. But, I could not do it simple reading the file content.

Finally found a tool that does what i was trying to do manually. This is light weight tool with easy to update external data dictionary for file finger print matching data.

Utility software details:

TrID

is free for personal / non commercial use.

URL: http://mark0.net/soft-trid-e.html

Direct download:

TrID is free for personal / non commercial use.

 Win32  TrID v2.24, 47KB ZIP(PGP sig)
 Linux/x86  TrID v2.24, 357KB ZIP(PGP sig)
 Linux/x86-64  TrID v2.24, 421KB ZIP(PGP sig)
 TrIDUpdate v1.00, 1KB ZIP (Python 2.7.x required)
 TrIDDefs.TRD package, 982KB ZIP (7647 file types, 15/11/16)

SQL Server 2016 – Arrived

June 3, 2016 Leave a comment

This is a good news for the SQL Server community for this year. Microsoft has released SQL Server 2016 on June 1st  2016.

You need to sign-up to download the evaluation edition from this web page.

https://www.microsoft.com/en-us/evalcenter/evaluate-sql-server-2016

There are many exciting features in this version. Now, SQL Server has moved to the top of the database management servers ladder.

GartnerMQ_ODBMS

 

Categories: SQL Server

Insert or Update a File in Database – SQL Server

February 17, 2016 Leave a comment

Database is a repository for data of various formats. In the past, we use text files to store huge data and technology revolution has changed everything for what we store and How we store data. Big data is a good example. It happened in different forms as punch card, file system, relational database, graph db, NoSQL, NewSQL and etc.

But, in this blog post I am going to show a simple example for storing (insert) and altering (update) a binary image file stored in a table.

Prerequisite

Create a Table

CREATE TABLE [dbo].[Images](
ImageID INT IDENTITY(1,1),
ImageDesc VARCHAR(20) NOT NULL,
[ImageData] VARBINARY(MAX) NOT NULL
) ON [PRIMARY]

Sample Image file – SQL2016.jpg

SQL2016

Insert a record with a Image file

INSERT dbo.[Images]
(ImageDesc, ImageData)
SELECT ‘SQL2016′ AS ImageDesc, * FROM OPENROWSET(BULK N’C:\Test\SQL2016.jpg’, SINGLE_BLOB) AS Img

Update an existing record with Image file

UPDATE dbo.[Images]
SET ImageDesc = ‘SQLServer’
,ImageData = BulkColumn from Openrowset( Bulk ‘C:\Test\SQLServer.jpg’, Single_Blob) as Img
WHERE ImageID = 1

This blog post is for code reference. You can use this code with not restriction.

Categories: SQL Server

The final edition DWH and BI reference

January 10, 2016 2 comments

Ralph Kimball and the Kimball Group have continued to refine their methods and techniques based on thousands of hours of consulting and training. This Remastered Collection of The Kimball Group Reader represents their final body of knowledge, and is nothing less than a vital reference for anyone involved in the field.

  1.  Learn data warehousing and business intelligence from the field’s pioneers
  2. Get up to date on best practices and essential design tips
  3. Gain valuable knowledge on every stage of the project lifecycle
  4. Dig into the Kimball Group methodology with hands-on guidance

Download this book

Thanks

Categories: Book, Data Warehouse

Connect to SQL Server in R without ODBC DNS connection

September 25, 2015 3 comments

In the previous post, I have explained the steps to connect to SQL Server with ODBC DSN.

In this blog post, I am going to connect to SQL Server without ODBC DSN. But, will be using driver name instead.

Step 1: RODBC must be installed in R. Please read (Connect to SQL Server in R for detail)

Step 2: Load the RODBC library

library(RODBC)

Step 3:Connecting to SQL Server with Driver name

MSConnection <- odbcDriverConnect(“DRIVER=SQL SERVER;SERVER=.;Trusted_Connection=Yes”)

This connection point to the default database initially. But, we can run USE statement to change the database.

sqlQuery(MSConnection, “USE test”)

Step 4: Read the table data to a variable

mydata <- sqlQuery(MSConnection, “Select * from dates”)

Step 5: Display data by just typing the variable name in R command environment

mydata

Step 6: Close the connection

close(MSConnection)

RODBC documentation

Categories: R Tags: ,

Connect to SQL SERVER in R

September 20, 2015 1 comment

R is an OPEN SOURCE software environment for statistical computing and graphics. It is easy to use and create valuable data visualization in a minute. Learn more about R.

This blog post is to explain the steps to connect to SQL Server database in R and display simple graphics.

Over all steps

  1. Create ODBC Data Source
  2. Setup R environment to connect to SQL Server
  3. Query the SQL table, display data and graphics

Step 1: Create ODBC Data Source:

Goto, Control Panel -> Administrative Tools -> Data Sources (ODBC)

DSN1

Click Add button

dsn2

select SQL Server Native Client and click Finish

dsn3

Give data source name and SQL Server name to connect and Click Next

dsn4

Select an appropriate SQL Server authentication option and give valid credential. In this example, we are using Integrated Windows Authentication. Click next

dsn5

Select the database to work with and modify the application intent option to Read-only. These settings are for this exercise only. We may use default setting and click next.

dsn6

Click finish and TEST connection

dsn7

Step 2: Setup R environment to connect to SQL Server.  Please install R software.

Install RODBC package to R:

  • install.packages(“RODBC”)

Load the RODBC library to current environment to use:

  • library(RODBC)

Connect to SQL Server using ODBC connection:

  • wrpt <-odbcConnect(“weatherdata”)

We have just connected to SQL Server and the R connection variable name is wrpt. We can use this variable to query a table and more.

Step 3: Query the SQL table to display data and graphics

This statement loads the entire table “tblTemp” in to the variable weather.

weather <- sqlFetch(wrpt, “tblTemp”)  

This statement displays the entire table

print(weather)

This statement displays the summary of the data-set

summary(weather)

rdata

This statement displays a graph with daily max temperature for a  month

plot(weather$maxtemp, type=”l”)

rgraph

R manuals

Thanks for reading this post.

Categories: R Tags:
%d bloggers like this: