p.

BSOD based on VmWare Network Driver

2010-12-06T01:26:00.001+02:00

This week I was in IBM’s place to learn WPS. In the second morning of that course my windows box crashed with a BSOD. The IBM guys claimed it was normal to windows to do that. To be honest I’m not a Microsoft fan but I trust windows’ stability. So at that moment I started to analyze the core dump which was generated by this crash. . In the picture below you’ll see that vmware network driver caused windows to crash. Windows was not crashed because of itself

How to disable Security in Websphere Application Server 7

2010-09-07T09:54:00.001+03:00

When working on WAS you can enable and disable security for testing purposes. A few times i configured WAS security and could not logined to the system. If there is a need to disable security on WAS you can disable by setting the property enabled to false.
<was_installation_dir>/profiles/<profileName>/config/cells/cell_name

<security:Security xmi:version="2.0" 
xmlns:xmi="http://www.omg.org/XMI" 
xmlns:orb.securityprotocol="http://www.ibm.com/websphere/appserver/schemas/5.0/orb.securityprotocol.xmi" 
xmlns:security="http://www.ibm.com/websphere/appserver/schemas/5.0/security.xmi"
 xmi:id="Security_1" useLocalSecurityServer="true" 
useDomainQualifiedUserNames="false" 
enabled="true"cacheTimeout="600" issuePermissionWarning="true" 
activeProtocol="BOTH" enforceJava2Security="false" 
enforceFineGrainedJCASecurity="false" appEnabled="true" 
dynamicallyUpdateSSLConfig="true" allowBasicAuth="true" 
activeAuthMechanism="LTPA_1" 
activeUserRegistry="LDAPUserRegistry_1" 
defaultSSLSettings="SSLConfig_GMCIMIT891Node02_1" adminPreferredAuthMech="RSAToken_1">

Using TCP/IP Monitor Plug-in in Eclipse

2010-09-06T11:35:00.001+03:00

Eclipse has various types of plug-ins. In this post you’ll find out how to configure tcp/ip monitor plugin in eclipse.
Eclipse’s TCP/IP Monitor works like a proxy server which configures itself in between client and server.
1.Configure TCP/IP Monitor listening port which is not used for an application. This port will your gateway for your requests. So In the picture below you can assume that an application is working on tcp:9080.

2. Send requests from 9081

3. Investigate your requests.

Webpshere Process Server – Extracting WPS’s tables with JxInsight

2010-08-27T17:37:00.001+03:00

Up to now with jxinsight, we made hotspot, transction, delta analysis and ..etc. But this time because i could not find any document about wps’s metadata tables we installed jxinsight on wps and extract every table which wps touches.

In WPS StartUp SQLs
BPEME

Webpshere Process Server – Process Versioning

2010-08-27T09:46:00.001+03:00

As you can get information from my previous posts long running processes can run for minutes, hours, years. As the time goes business requirements can change, or company policies can change as well. In the name of giving an example for an EFT Process policies was chnaged in 2001 but you want your process instances to processed in older policies. The process clains which were created after 2001 have to be processed in new policies. This is typical case of process versioning lifecycle. IBM Webpshere Process server uses timestamp approach for process versioning.
Process versioning can be activated by setting validFrom property of the process.

Websphere Integration Developer 7 – Invoking EJB Modules

2010-08-27T01:03:00.001+03:00

1. Create an EJB Project

Click Next, and then fill the fields with the texts below written in italic.
Project Name : CoffeeShopEJB
Target Runtime : Websphere Process Server 7.0
EJB Module Version : 2.1
EAR Project Name : CoffeeShopEJBApp

2. Create an Stateless EJB

3. Open CoffeePricePredictorBean.java and then add this method below

public double predictPrice(String coffeeType)
{
    System.out.println("*************EJB Mehtod is invoked****************");
    System.out.println("ejb.samples.coffee.CoffePricePredictorBean.predictPrice");
    return 5d;
}

4. From the outline panel click predictPrice method and click promote to remote interface option

Ok then if you follow these 5 steps you have a working EJB Module. After these steps you will find how to invoke these methods from a process/

5.Create a simple module with following the steps in HelloWorldProcess post but the module name in my sample is CoffeeEJBInvoker.

6. Create the process interface

7. Create the CoffeePricePredictorProcess as a micro-flow process

8. Design your process

9. Add the process interface CoffeePricePredictorProcess as a ReferencePartner. What you have to do is just drag and drop CoffeePricePredictorProcess to the process design panel.

10. From the Details tab of InvokeCoffeePricePredictorService fill the fields like the picture below.

11. From the project dependencies section add EJBClient as java library

12. Open Assembly Diagram Panel and drag and drop CoffeePricePredictorProcess into the panel.

13. Drag and Drop Enterprice JavaBeans component into AssemblyDiagram panel to JavaBeans component. Select the interface below.

14 . Link the process component to Enterprice JavaBeans component. WID will ask the mediation module. Since i do not add java component to invoke EJB, WID creates a mediation for invocation.

15. Double click mediation which is in the middle.

Click predictPrice and select ServiceIntegration

16. Add reference operation

17. For the request operation link CoffeePricePredictorProcess to partner1. Since this operation needs transformation choose XSLT transformation.

18 Double clik XSLTTranformation1

19. Map the fields

20. So up to know we made the process invoke ejb module in terms of mediation we designed request operation . But this operation is request and response operation we need to implement response operation.

Click response tab.

21. Link partner1 component to CoffeePricePredictorProcess

22. Choose XSLT Transformation

23. Double click XSLST Transformation1 component

24.Map appropriate fields

25. Process design section is finished. So we can test our process.

26.

27. The Test result

Getting Started with IBM Websphere Integration Developer – Designing Hello World Process – Invoking WebServices

2010-08-26T02:23:00.001+03:00

1. Do all the steps in Getting Started with IBM Websphere Integration Developer – Designing Hello World Process post
2. Create a Dynamic Web Project

3. Write the properties of the Dynamic Web Project relying in the picture below

3. Create a class named Hello

4. Copy and paste the code below

     package com.samples.hello;

    public class Hello {

        public String sayHello(String name)

        {

            System.out.println("Hello.sayHello invoked ");

            System.out.printf("Hello.sayHello ( %s ) ",name);

            return "Hello  " + name;

        }

    }

5. Create a web service from the Hello Class

6. Click next for a few times. After that the web application will be deployed automatically by the help of WID.

7. In the HelloWorld module project. Click Interfaces, and then click import

8. Select wsdl and XSD for import type

9.Because the HelloWorldService is deployed on your local machine or remote server you can select remote wsdl location

10. Write wsdl remote path

11.Select Hello service interface. Drag and drop to procecc design template

12. In the reference partners you have to see Hello

13. Select Invoke component. Drag and Drop to HelloProcess design tab.

13. Rename to HelloServiceInvoker

14. Click Details tab of HelloServiceInvoker, apply the same properties to your InvokeHelloService properties

15.Open assembly diagram. Drag and drop Hello interface to assembly diagram. Choose import with WebService Binding

16.In the Web Service Import Details click Use an existing web service port and choose your hello web service.

17. Refresh your project and then link the process with the Hello Web Service

18. Test your Process with BPC.

Getting Started with IBM Websphere Integration Developer – Designing Hello World Process

2010-08-26T01:23:00.001+03:00

1. Create a module named HelloWorld

2. Select module as a development project type

3. Create a process named HelloWorldProcess. The process type shoud be micro flow since there is no human interaction.

4. Select the radiobutton which is Generate a new interface. The new interface takes a string as input and returns a string as output.

5. From the palette select snippet, drag and drop it between reply and receive components.

6. In the properties view of snippet change the name and display name to HelloSnippet.

7. In the properties pane select Details tab and switch to the java view. Write the code below

8. Click assembly diagram. Drag and drop your process to the diagram.

9. Deploy your first process to IBM Webpshere Process Server 7.0
10. Launch BPC Explorer.

11. Create a process instance
        - In the Process Templates widget click Currently Valid
        - Click Start Instance
        - For the input you can write your a name

12. Look at the consoles view. You have to see sth like in the log file

     [8/26/10 1:15:53:391 EEST] 0000008f servlet       I com.ibm.ws.webcontainer.servlet.ServletWrapper init SRVE0242I: [BPCExplorer_qnode_server1] [/bpc] [/pages/layouts/views/ProcessTemplateListView.jsp]: Initialization successful.

    [8/26/10 1:15:53:501 EEST] 0000008f servlet       I com.ibm.ws.webcontainer.servlet.ServletWrapper init SRVE0242I: [BPCExplorer_qnode_server1] [/bpc] [/pages/layouts/content/lists/ProcessTemplateList.jsp]: Initialization successful.

    [8/26/10 1:16:09:467 EEST] 00000090 servlet       I com.ibm.ws.webcontainer.servlet.ServletWrapper init SRVE0242I: [BPCExplorer_qnode_server1] [/bpc] [/pages/layouts/views/ProcessTemplateDetailsView.jsp]: Initialization successful.

    [8/26/10 1:16:09:557 EEST] 00000090 servlet       I com.ibm.ws.webcontainer.servlet.ServletWrapper init SRVE0242I: [BPCExplorer_qnode_server1] [/bpc] [/pages/layouts/content/details/ProcessTemplateDetails.jsp]: Initialization successful.

    [8/26/10 1:16:11:589 EEST] 00000090 servlet       I com.ibm.ws.webcontainer.servlet.ServletWrapper init SRVE0242I: [BPCExplorer_qnode_server1] [/bpc] [/pages/layouts/views/ProcessInputMessageView.jsp]: Initialization successful.

    [8/26/10 1:16:11:619 EEST] 00000090 servlet       I com.ibm.ws.webcontainer.servlet.ServletWrapper init SRVE0242I: [BPCExplorer_qnode_server1] [/bpc] [/pages/layouts/content/ProcessInputMessage.jsp]: Initialization successful.

    [8/26/10 1:16:21:021 EEST] 00000090 SystemOut     O The Input is : osman

Supported and Unsupported LDAP Namespace Structures

2010-08-24T16:34:00.001+03:00

The picture below explains everything about ldap namespace structures

[Understanding and Deploying LDAP Directory Services, Second Edition By Timothy A. Howes Ph.D., Mark C. Smith,Gordon S. Good]

Developing Custom AuthenticationHandler for Central Authentication Services (CAS)

2010-08-23T19:00:00.001+03:00

Central Authentication Services provides various types of authentication handlers like jdbc, ldap, X.509 Certificates. In some circumstances developing custom authentication handler for your company can be vital. In this post, you will find how to develop custom authentication handlers for cas.

CAS as you know is a maven project, so it is really easy to code and easy to develop.
1. Create a module in cas-server.pom xml

2. Create Class named CustomPasswordAuthenticationHandler

package com.yourcompany.cas.adaptors.custom;

import java.net.InetAddress;
import java.net.UnknownHostException;
import java.sql.CallableStatement;
import java.sql.Connection;
import java.sql.SQLException;
import java.sql.Types;

import org.jasig.cas.adaptors.jdbc.AbstractJdbcUsernamePasswordAuthenticationHandler;
import org.jasig.cas.authentication.handler.AuthenticationException;
import org.jasig.cas.authentication.principal.UsernamePasswordCredentials;
import org.springframework.beans.factory.InitializingBean;
import org.springframework.jdbc.core.CallableStatementCallback;
import org.springframework.jdbc.core.CallableStatementCreator;

import com.sun.istack.NotNull;

public class CustomPasswordAuthenticationHandler extends AbstractJdbcUsernamePasswordAuthenticationHandler implements InitializingBean {
    @NotNull
    private String sql;

    public void setSql(String sql) {
        this.sql = sql;
    }

    public void afterPropertiesSet() throws Exception {
        // TODO Auto-generated method stub
    }

    @Override
    protected boolean authenticateUsernamePasswordInternal(final UsernamePasswordCredentials credentials) throws AuthenticationException {
        return ((String) getJdbcTemplate().getJdbcOperations().execute(new CallableStatementCreator() {
            public CallableStatement createCallableStatement(Connection conn) throws SQLException {
                CallableStatement cs = conn.prepareCall(sql);
                cs.setString(2, credentials.getUsername());
                cs.setString(3, credentials.getPassword());
                cs.setString(4, getHostName());
                cs.setString(5, getHostAddress());
                cs.registerOutParameter(1, Types.VARCHAR);
                return cs;
            }
        }, new CallableStatementCallback<String>() {
            public String doInCallableStatement(CallableStatement cs) {
                try {
                    cs.execute();
                    return cs.getString(1);
                } catch (SQLException e) {
                    // TODO Auto-generated catch block
                    e.printStackTrace();
                }
                return ""; // Whatever is returned here is returned from the jdbcTemplate.execute method
            }
        })).charAt(0) == '0';
    }

    private String getHostName() {
        try {
            return InetAddress.getLocalHost().getHostName();
        } catch (UnknownHostException uhe) {
            // TODO: Logger
            return "";
        }
    }

    private String getHostAddress() {
        try {
            return InetAddress.getLocalHost().getHostAddress();
        } catch (UnknownHostException uhe) {
            // TODO: Logger
            return "";
        }
    }
}

3. Add this project as a dependency to cas-server-webapp project

<dependency>
    <groupId>${project.groupId}</groupId>
    <artifactId>cas-server-support-custom</artifactId>
    <version>${project.version}</version>
</dependency>

4. Add your custom AuthenticationHandler to cas-server-webapp/WEB-INF/deployerConfigContext.xml

<bean
    class="com.yourcompany.cas.adaptors.custom.CustomPasswordAuthenticationHandler">
    <property name="sql">
        <value>a SQL code <value>
    </property>
    <property name="dataSource" ref="yourDatasource"/>
</bean>

Integrating WAS 7.0 with JxInsight

2010-08-20T01:04:00.001+03:00

1. Copy jxinsigt-ext-*.jar files which are highlighted below into websphere lib directory.

2. copy jxinsight.dll into ${websphereInstallationDirectory}\java\jre\bin directory

3. Configure java runtime parameters from

Parameters:

-javaagent:${JXINSIGHT_LIB}\\aspectjweaver.jar=cache=false -agentpath:C:/dev/tools/ibm/WID7_WTE/runtimes/bi_v7/java/bin/jxinsight.dll=prod -Djxinsight.server.aspectj.transform.thread.contextclassloader.hide.enabled=false

4. put these parameters into server.policy file

grant {

permission java.util.PropertyPermission "aj.weaving.verbose", "read";

permission java.util.PropertyPermission "org.aspectj.tracing.messages", "read";

permission java.util.PropertyPermission "org.aspectj.weaver.showWeaveInfo", "read";

permission java.util.PropertyPermission "org.aspectj.weaver.loadtime.configuration", "read";

};
5. jxinsight.aspectj.filters.config configuration
JxInsight uses this file for instrumenting classes.
In our case you have to put this file into
C:\dev\tools\ibm\WID7_WTE\runtimes\bi_v7\profiles\ProcSrv04 directory which is the parent directory of profiles bin folder. Especially because com.ibm packages are encrypted instrumenting your own code base classes is more meaningfull. Putting this line !com.ibm will have made jxinsight disable instrumenting com.ibm packages.

6. jxinsihgt.override.config which is used for jxinsight properties have to be in same directory as step 5. Please read release-notes.txt in jxisnight installation folder.

Enabling Group Work Items on WPS

2010-08-19T11:19:00.001+03:00

Application servers > server1 > Human Task Manager

Deleting WPS Profile

2010-08-19T09:56:00.001+03:00

C:\dev\tools\ibm\WID7_WTE\runtimes\bi_v7\bin>manageprofiles.bat -delete -profilename ProcSrv03

Integrating WPS with Microsoft Active Directory

2010-08-11T13:26:00.001+03:00

1 .WPS Admin Console –>-Global Security –>

2.
3.
For step 4 generally i prefer using ldp.exe
4.
5.

org.xml.sax.SAXParseException: schema_reference.4: Failed to read schema document 'https://jax-ws.dev.java.net/spring/servlet.xsd', because 1) could not find the document; 2)

2010-07-28T09:51:00.001+03:00

org.xml.sax.SAXParseException: schema_reference.4: Failed to read schema document 'https://jax-ws.dev.java.net/spring/servlet.xsd', because 1) could not find the document; 2) the document could not be read; 3) the root element of the document is not <xsd:schema>.
at org.apache.xerces.util.ErrorHandlerWrapper.createSAXParseException(Unknown Source)
at org.apache.xerces.util.ErrorHandlerWrapper.warning(Unknown Source)
at org.apache.xerces.impl.XMLErrorReporter.reportError(Unknown Source)
at org.apache.xerces.impl.XMLErrorReporter.reportError(Unknown Source)
at org.apache.xerces.impl.xs.traversers.XSDHandler.reportSchemaWarning(Unknown Source)
at org.apache.xerces.impl.xs.traversers.XSDHandler.getSchemaDocument(Unknown Source)
at org.apache.xerces.impl.xs.traversers.XSDHandler.parseSchema(Unknown Source)
at org.apache.xerces.impl.xs.XMLSchemaLoader.loadSchema(Unknown Source)
at org.apache.xerces.impl.xs.XMLSchemaValidator.findSchemaGrammar(Unknown Source)
at org.apache.xerces.impl.xs.XMLSchemaValidator.handleStartElement(Unknown Source)
at org.apache.xerces.impl.xs.XMLSchemaValidator.emptyElement(Unknown Source)
at org.apache.xerces.impl.XMLNSDocumentScannerImpl.scanStartElement(Unknown Source)
at org.apache.xerces.impl.XMLDocumentFragmentScannerImpl$FragmentContentDispatcher.dispatch(Unknown Source)
at org.apache.xerces.impl.XMLDocumentFragmentScannerImpl.scanDocument(Unknown Source)
at org.apache.xerces.parsers.XML11Configuration.parse(Unknown Source)

The only way to fix this kind of exception is

1. Download xsd file into yoru local

2. Add xsd file location to your eclipses’s XML Catalog


Location:    spring-jax-ws-servlet.xsd in jar file C:\dev\tools_data\maven_local_repo\org\jvnet\jax-ws-commons\spring\jaxws-spring\1.8\jaxws-spring-1.8.jar
URI:           jar:file:C:/dev/tools_data/maven_local_repo/org/jvnet/jax-ws-commons/spring/jaxws-spring/1.8/jaxws-spring-1.8.jar!/spring-jax-ws-servlet.xsd
Key Type:    Namespace Name
Key:        http://jax-ws.dev.java.net/spring/servlet.xsd

Creating Spring WebServices part 2

2010-07-28T09:41:00.001+03:00

In this post you will find how to create spring web services. The different part from part 1 is this type of web services uses application servers' listener. What i’m trying to say is in part 1 with configuration of creates a new listener.

<bean class="org.springframework.remoting.jaxws.SimpleJaxWsServiceExporter">
    <property name="baseAddress" value="http://localhost:9080/" />
</bean>

In this part you’ll find how to publish web services from an application servers’ listener.

1.Define your web service bean in your applicationContext.xml

<bean id="clientWebService" class="com.montoya.ClientServiceEndpoint" />

2. Add these lines into your web.xml

<context-param>
    <param-name>contextConfigLocation</param-name>
    <param-value>/WEB-INF/Spring-servlet.xml</param-value>
</context-param>
<servlet>
    <servlet-name>jaxws-servlet</servlet-name>
    <servlet-class>com.sun.xml.ws.transport.http.servlet.WSSpringServlet</servlet-class>
</servlet>
<servlet-mapping>
    <servlet-name>jaxws-servlet</servlet-name>
    <url-pattern>/ClientService</url-pattern>
</servlet-mapping>

3. Bind the url which is ClientService in our sample, with a bean.

<?xml version="1.0" encoding="UTF-8"?>
<beans xmlns="http://www.springframework.org/schema/beans"
    xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
    xmlns:aop="http://www.springframework.org/schema/aop"
    xmlns:context="http://www.springframework.org/schema/context"
    xmlns:ws="http://jax-ws.dev.java.net/spring/core"
    xmlns:wss="http://jax-ws.dev.java.net/spring/servlet"
    xsi:schemaLocation="http://www.springframework.org/schema/beans
           http://www.springframework.org/schema/beans/spring-beans-2.5.xsd
           http://www.springframework.org/schema/aop
           http://www.springframework.org/schema/aop/spring-aop-2.5.xsd
           http://www.springframework.org/schema/context
           http://www.springframework.org/schema/context/spring-context-2.5.xsd
           http://jax-ws.dev.java.net/spring/core
           http://jax-ws.dev.java.net/spring/core.xsd
           http://jax-ws.dev.java.net/spring/servlet
           http://jax-ws.dev.java.net/spring/servlet.xsd">

    <import resource="applicationContext.xml"/>

    <wss:binding url="/ClientService">
        <wss:service>
            <ws:service bean="#clientWebService" />
        </wss:service>
    </wss:binding>
</beans>

maven org.codehaus.mojo jaxws plugin generate source files from local wsdl files

2010-07-27T14:39:00.001+03:00

In a development phase, sometimes webservices are not online. So when generating java sources from remote wsdl file is not possible in that situations. If you are using org.codehaus.mojo jaxws maven plugin generating java sources from local wsdl files is possible in a few steps.
1. download wsdl files and save into src/wsdls directory
2. add the codes below into webservive consumer project’s pom.xml

<build>
    <plugins>
        <plugin>
            <groupId>org.codehaus.mojo</groupId>
            <artifactId>jaxws-maven-plugin</artifactId>
            <executions>
                <execution>
                    <goals>
                        <goal>wsimport</goal>
                    </goals>
                    <configuration>
                        <wsdlDirectory>${basedir}/src/wsdls</wsdlDirectory>
                        <packageName>com.montoya.ferp.client</packageName>
                    </configuration>
                </execution>
            </executions>
        </plugin>
    </plugins>
</build>

Integrating Spring WebServices with Maven

2010-07-27T09:57:00.001+03:00

As you know in java world we can implement webservices in different ways. This post is step by step telling you how you have to implement spring webservices with maven.
Creating WebServices
1.add this plugin tag into your pom.xml which you are going to deploy.

<plugin>
    <groupId>ch.elca.el4j.maven.plugins</groupId>
    <artifactId>maven-jaxws-plugin</artifactId>
    <version>1.6</version>
    <executions>
        <execution>
            <goals>
                <goal>wsgen</goal>
            </goals>
        </execution>
    </executions>
</plugin>

2. Create a class into your maven project.

Annotate class as

@WebService(serviceName= "ClientService")

Annotate method as @WebMethod

@WebService(serviceName = "ClientService")
public class ClientServiceEndpoint implements InitializingBean, IClientService {
    private IClientService clientService;

    @Override
    public void afterPropertiesSet() throws MandatoryPropertyException {
        if (clientService == null) {
            throw new MandatoryPropertyException(ClientServiceEndpoint.class, "clientService");
        }
    }

    @Override
    @WebMethod
    public Client findByClientNumber(Integer clientNumber) throws ClientNotFoundException {
        return clientService.findByClientNumber(clientNumber);
    }

3. put the lines into your pom.xml

<bean class="org.springframework.remoting.jaxws.SimpleJaxWsServiceExporter">
        <property name="baseAddress" value="http://localhost:9080/" />
    </bean>

    

    <bean class="com.ykb.ferp.cdm.ws.ClientServiceEndpoint">
        <property name="clientService" ref="cdm.service.client" />
    </bean>

4. Deploy into your application server.

Consuming Spring Web Services

1. put this plugin code into your client pom.xml

<plugin>
    <groupId>org.codehaus.mojo</groupId>
    <artifactId>jaxws-maven-plugin</artifactId>
    <executions>
        <execution>
            <goals>
                <goal>wsimport</goal>
            </goals>
            <configuration>
                <wsdlUrls>
                    <wsdlUrl>http://localhost:9080/ClientService?wsdl</wsdlUrl>
                </wsdlUrls>
                <packageName>com.ykb.ferp.client</packageName>
            </configuration>
        </execution>
    </executions>
</plugin>

2. Right click your project from eclipse and execute update maven configuration project

This will generate web services proxy, interface stub code into your project.

3. put this tag into your application configuration xml depending on your automatic generated code.

<bean id="clientWebService"
    class="org.springframework.remoting.jaxws.JaxWsPortProxyFactoryBean">
    <property name="serviceInterface"
        value="com.ykb.ferp.client.ClientServiceEndpoint" />
    <property name="wsdlDocumentUrl"
        value="file:${ferp.configuration.base}/ferp-cdm-ws/ClientService.wsdl" />
    <property name="namespaceUri" value="http://ws.cdm.ferp.ykb.com/" />
    <property name="serviceName" value="ClientService" />
    <property name="portName" value="ClientServiceEndpointPort" />
    <property name="endpointAddress" value="http://localhost:9080/ClientService"></property>
</bean>

IBM RRC (Rational Requirements Composer) Freezes and Hangs

2010-07-23T14:57:00.001+03:00

Previous week an analyst told us that IBM RRC hangs does not response to user. After this i started to investigate the problem. In the text below you will see step by step hang analysis on RRC hangs.
1. Enable JMX connections to dump threads.
In the picture below you’ll see where you have to put this parameters.
Dcom.sun.management.jmxremote.port=9999 -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.ssl=false

2. Connect via JConsole
3. Investigate threads
4. In our case the problem is related with StreamWriter. so we just put these parameters to get rid of encoding problem.
Duser.language=en -

Integrating Maven with IBM Rational Application Developer (RAD) 7.5

2010-07-23T13:39:00.001+03:00

For three days i have read every website related with RAD and maven. To be honest there is nothing you can find with this issue so i’ve just decided to post this entry.

1. Install GEF on RAD
Location: http://download.eclipse.org/tools/gef/updates/releases/
2. Install m2eclipse on RAD
http://m2eclipse.sonatype.org/sites/m2e
3. Create a folder on your workspace named MavenRadParent
4. Create the Folder and File Structure like the picture below

5. MavenRadProject (The Parent Directory)
parent pom

     <?xml version="1.0" encoding="UTF-8"?>

    <project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/maven-v4_0_0.xsd">

        <modelVersion>4.0.0</modelVersion>

        <groupId>montoya-mr</groupId>

        <artifactId>montoya-mr-parent</artifactId>

        <name>Montota Maven Rad Integration Demo</name>

        <version>0.0.1-SNAPSHOT</version>

        <packaging>pom</packaging>

        <modules>

                <module>mr-jar</module>

                <module>mr-web</module>

                <module>mr-ear</module>

        </modules>

        <build>

            <plugins>

                    <plugin>

                        <groupId>org.apache.maven.plugins</groupId>

                        <artifactId>maven-compiler-plugin</artifactId>

                        <configuration>

                            <source>1.5</source>

                            <target>1.5</target>

                        </configuration>

                  </plugin>

            </plugins>

        </build>    

    </project>

6. mr-jar pom

    <?xml version="1.0" encoding="UTF-8"?>

    <project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/maven-v4_0_0.xsd">

        <modelVersion>4.0.0</modelVersion>

        <groupId>montoya-mr</groupId>

        <artifactId>mr-jar</artifactId>

        <name>Maven Rad Integration Project  Jar POM</name>

        <version>0.0.1-SNAPSHOT</version>

        <packaging>jar</packaging>

        <parent>

            <groupId>montoya-mr</groupId>

            <artifactId>montoya-mr-parent</artifactId>

            <version>0.0.1-SNAPSHOT</version>

        </parent>

        <build>

            <plugins>

                <plugin>

                    <groupId>org.apache.maven.plugins</groupId>

                    <artifactId>maven-eclipse-plugin</artifactId>

                    <configuration>

                        <projectNameTemplate>[artifactId]</projectNameTemplate>

                        <classpathContainers>

                            <classpathContainer>org.eclipse.jdt.launching.JRE_CONTAINER</classpathContainer>

                        </classpathContainers>

                        <wtpmanifest>true</wtpmanifest>

                        <wtpapplicationxml>true</wtpapplicationxml>

                        <wtpversion>2.0</wtpversion>

                        <manifest>${basedir}/src/main/resources/META-INF/MANIFEST.MF</manifest>

                    </configuration>

                </plugin>

            </plugins>

        </build>

    </project>

7. mr-web pom

    <?xml version="1.0" encoding="UTF-8"?>

    <project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/maven-v4_0_0.xsd">

        <modelVersion>4.0.0</modelVersion>

        <groupId>montoya-mr</groupId>

        <artifactId>mr-web</artifactId>

        <name>Maven Rad Integration Project Web POM</name>

        <version>0.0.1-SNAPSHOT</version>

        <packaging>war</packaging>

        <parent>

            <groupId>montoya-mr</groupId>

            <artifactId>montoya-mr-parent</artifactId>

            <version>0.0.1-SNAPSHOT</version>

        </parent>

        <build>

            <plugins>

                <plugin>

                    <groupId>org.apache.maven.plugins</groupId>

                    <artifactId>maven-eclipse-plugin</artifactId>

                    <configuration>

                        <projectNameTemplate>[artifactId]</projectNameTemplate>

                        <classpathContainers>

                            <classpathContainer>org.eclipse.jdt.launching.JRE_CONTAINER</classpathContainer>

                        </classpathContainers>

                        <wtpmanifest>true</wtpmanifest>

                        <wtpapplicationxml>true</wtpapplicationxml>

                        <wtpversion>2.0</wtpversion>

                        <manifest>${basedir}/src/main/resources/META-INF/MANIFEST.MF</manifest>

                    </configuration>

                </plugin>

            </plugins>

        </build>

    </project>

8. mr-ear pom

    <?xml version="1.0" encoding="UTF-8"?>

    <project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"

        xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/maven-v4_0_0.xsd">

        <modelVersion>4.0.0</modelVersion>

        <groupId>texan.texan-wsmaven</groupId>

        <artifactId>mr-ear</artifactId>

        <name>Maven Rad Integration Project Ear POM</name>

        <version>0.0.1-SNAPSHOT</version>

        <packaging>ear</packaging>

        <parent>

            <groupId>montoya-mr</groupId>

            <artifactId>montoya-mr-parent</artifactId>

            <version>0.0.1-SNAPSHOT</version>

        </parent>

        <dependencies>

            <dependency>

                <groupId>montoya-mr</groupId>

                <artifactId>mr-web</artifactId>

                <version>0.0.1-SNAPSHOT</version>

                <type>war</type>

            </dependency>

        </dependencies>

        <build>

            <plugins>

                <plugin>

                    <groupId>org.apache.maven.plugins</groupId>

                    <artifactId>maven-eclipse-plugin</artifactId>

                    <configuration>

                        <wtpversion>2.0</wtpversion>

                        <additionalBuildcommands>

                            <buildcommand>org.eclipse.wst.validation.validationbuilder</buildcommand>

                            <buildcommand>org.eclipse.wst.common.project.facet.core.builder</buildcommand>

                        </additionalBuildcommands>

                        <additionalProjectnatures>

                            <projectnature>org.eclipse.wst.common.project.facet.core.nature</projectnature>

                            <projectnature>org.eclipse.wst.common.modulecore.ModuleCoreNature</projectnature>

                        </additionalProjectnatures>

                        <additionalProjectFacets>

                            <jst.ear>1.6</jst.ear>

                            <com.ibm.websphere.extended.web>7.0</com.ibm.websphere.extended.web>

                            <com.ibm.websphere.coexistence.web>7.0</com.ibm.websphere.coexistence.web>

                        </additionalProjectFacets>

                    </configuration>

                </plugin>

            </plugins>

        </build>

    </project>

9. Open the project from RAD as an existing maven project

Hibernate Criteria API and Projections

2009-11-01T01:52:00.001+02:00

1. Group by

ProjectionList proList = Projections.projectionList();
proList.add(Projections.property("companyname"));
proList.add(Projections.count("companyname"));
proList.add(Projections.groupProperty("companyname"));

Criteria criteria = session.createCriteria(Customers.class);
criteria.setProjection(proList);

List groupedCompanyNames = criteria.list();

Output :

2. Distinct

ProjectionList proList = Projections.projectionList();
proList.add(Projections.distinct(Projections.property("companyname")));
Criteria criteria = session.createCriteria(Customers.class);
criteria.setProjection(proList);
        
List distinctdCompanyNames = criteria.list();

Output:

3. setResultTransformer

ProjectionList proList = Projections.projectionList();
proList.add(Projections.distinct(Projections.property("companyname")));
proList.add(Projections.count("companyname"));
proList.add(Projections.groupProperty("companyname"));
Criteria criteria = session.createCriteria(Customers.class);
criteria.setProjection(proList);
        
List<Customers> customerList = criteria
    .setResultTransformer(new AliasToBeanResultTransformer(Customers.class)).list();

4. where in = subqueries

DetachedCriteria detachedCriteria = DetachedCriteria.forClass(Orders.class);
detachedCriteria.setProjection(Projections.distinct(Property.forName(("customers"))));

ProjectionList proList = Projections.projectionList();
proList.add(Projections.distinct(Projections.property("companyname")));
proList.add(Projections.property("customerid"));
proList.add(Projections.count("companyname"));
proList.add(Projections.groupProperty("companyname"));
proList.add(Projections.groupProperty("customerid"));
Criteria criteria = session.createCriteria(Customers.class);


criteria.add(Property.forName("customerid").in(detachedCriteria));
criteria.setProjection(proList);
        

List<Customers> customerList = criteria
    .setResultTransformer(new AliasToBeanResultTransformer(Customers.class)).list();

Technorati Tags: Hibernate,Criteria,Property

JxInsight – How many times i’ve connected a database ?

2009-10-30T03:42:00.001+02:00

If you enable jdbinsight, you can trace your database activities from jxinsight console. To do this configuration copy
{jxinsight}\lib\jxinsight-jdbc-drivers.jar,
{jxinsight}\lib\jjxinsight-ext-aj-jdbc-namedprobes.jar files to your application server’s lib directory.
Add jxinsight.aspectj.filters oracle.
After doing that configuration you will see that url tab is enabled in jxInsight console.

From JxInsight’s profile section, you will see JDBC Resources. From this tab looking at the picture below it is easily understood that, a piece of code is executed 100 times over a connection.

JxInsight – Where in my code is executed most of the time

2009-10-29T20:51:00.001+02:00

In JxInsight just looking at Percentage Total Inherent column you can watch where in your code is executed in most of the time. Just to show, i developed a sample Hibernate application which opens and closes a connection in hundred times.

for(int i = 0; i < 100; ++i)
{
    Session session = HibernateUtil.getSession();
    Criteria criteria = session.createCriteria(Customers.class);
    criteria.setProjection(Projections.projectionList().
            add(Projections.count("customerid")).
            add(Projections.groupProperty("customerid"))
            );
    
    
    criteria.add(Expression.eq("customerid", "ALFKI"));
    criteria.setComment("Sample Comment");
    
    List<Object> list = criteria.list();

For that code, JxInsight shows me that most of the connection is the most significant time consuming code as you can see from the picture below.

From the snapshot, it can be easily understood that what it have to be done is managing the connection.

Profiling with JxInsight

2009-10-29T20:28:00.001+02:00

Nowadays most of my time, i’m dealing with profiling to optimize our code. Previous week i met William Louth who is the founder of Jinspired company. Today’s post is about his software jxinsight which i like to work on.

Profiling is a topic of performance engineering. First of all you have to learn what the system is made of and what is the key components which have been used. With JxInsight you have a chance to see which components are used.

Technorati Tags: Performance Engineering,JxInsight,Java

Organic Software Days

2009-10-20T19:02:00.001+03:00

Hibernate and NHibernate Configuration : Step 1

2009-10-13T03:27:00.001+03:00

Today’s post is about configuring NHibernate and Hibernate. In Eclipse, i haven’t configured my eclipse environment by hibernate tools so i created a project with Netbeans and then copied all necessary files to eclipse’s workspace.

1. Configure hbm files
Java Verion :

<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE hibernate-mapping PUBLIC "-//Hibernate/Hibernate Mapping DTD 3.0//EN" "http://hibernate.sourceforge.net/hibernate-mapping-3.0.dtd">
<!-- Generated Oct 6, 2009 1:42:21 AM by Hibernate Tools 3.2.1.GA -->
<hibernate-mapping>
  <class name="com.montoya.orm.Customers" schema="SYSTEM" table="CUSTOMERS">
    <id name="customerid" type="string">
      <column length="5" name="CUSTOMERID"/>
      <generator class="assigned"/>
    </id>
    <property name="companyname" type="string">
      <column length="40" name="COMPANYNAME" not-null="true"/>
    </property>
    <property name="contactname" type="string">
      <column length="30" name="CONTACTNAME"/>
    </property>
    <property name="contacttitle" type="string">
      <column length="30" name="CONTACTTITLE"/>
    </property>
    <property name="address" type="string">
      <column length="60" name="ADDRESS"/>
    </property>
    <property name="city" type="string">
      <column length="15" name="CITY"/>
    </property>
    <property name="region" type="string">
      <column length="15" name="REGION"/>
    </property>
    <property name="postalcode" type="string">
      <column length="10" name="POSTALCODE"/>
    </property>
    <property name="country" type="string">
      <column length="15" name="COUNTRY"/>
    </property>
    <property name="phone" type="string">
      <column length="24" name="PHONE"/>
    </property>
    <property name="fax" type="string">
      <column length="24" name="FAX"/>
    </property>
    <set inverse="true" name="orderses">
      <key>
        <column length="5" name="CUSTOMERID"/>
      </key>
      <one-to-many class="com.montoya.orm.Orders"/>
    </set>
    <set inverse="false" name="customerdemographicses" table="CUSTOMERCUSTOMERDEMO">
      <key>
        <column length="5" name="CUSTOMERID" not-null="true"/>
      </key>
      <many-to-many entity-name="com.montoya.orm.Customerdemographics">
        <column length="10" name="CUSTOMERTYPEID" not-null="true"/>
      </many-to-many>
    </set>
  </class>
</hibernate-mapping>

.NET Version

<?xml version="1.0" encoding="utf-8" ?>
<hibernate-mapping xmlns="urn:nhibernate-mapping-2.2"  assembly="Montoya.Core" namespace="Montoya.Core">
  <class name="Montoya.Core.Customer,Montoya.Core" schema="SYSTEM" table="CUSTOMERS">
    <id name="CustomerId" column="CUSTOMERID" type="System.String" unsaved-value="1">
      <column length="5" name="CUSTOMERID"/>
      <generator class="assigned"/>
    </id>
    <property name="CompanyName" column="COMPANYNAME" type="System.String" length="40" not-null="true"></property>
    <property name="ContactName" column="CONTACTNAME" type="System.String" length="255" not-null="true"></property>
    <property name="ContactTitle" column="CONTACTTITLE" type="System.String" length="255" not-null="true"></property>
    <property name="Address" column="ADDRESS" type="System.String" length="255" not-null="true"></property>
    <property name="City" column="CITY" type="System.String" length="255" not-null="true"></property>
    <property name="Region" column="REGION" type="System.String" length="255" not-null="true"></property>
    <property name="PostalCode" column="POSTALCODE" type="System.String" length="255" not-null="true"></property>
    <property name="Country" column="COUNTRY" type="System.String" length="255" not-null="true"></property>
    <property name="Phone" column="PHONE" type="System.String" length="255" not-null="true"></property>
    <property name="Fax" column="FAX" type="System.String" length="255" not-null="true"></property>
    
  </class>
  
</hibernate-mapping>

2. Configure hibernate.cfg.xml

java version

<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE hibernate-configuration PUBLIC "-//Hibernate/Hibernate Configuration DTD 3.0//EN" "http://hibernate.sourceforge.net/hibernate-configuration-3.0.dtd">
<hibernate-configuration>
  <session-factory>
     <property name="hibernate.show_sql">true</property>
    <property name="hibernate.dialect">org.hibernate.dialect.OracleDialect</property>
    <property name="hibernate.connection.driver_class">oracle.jdbc.OracleDriver</property>
    <property name="hibernate.connection.url">jdbc:oracle:thin:@localhost:1521:testDB</property>
    <property name="hibernate.connection.username">system</property>
    <property name="hibernate.connection.password">xxx</property>
    <mapping resource="com/montoya/orm/Region.hbm.xml"/>
    <mapping resource="com/montoya/orm/Employees.hbm.xml"/>
    <mapping resource="com/montoya/orm/Territories.hbm.xml"/>
    <mapping resource="com/montoya/orm/Customerdemographics.hbm.xml"/>
    <mapping resource="com/montoya/orm/Orderdetails.hbm.xml"/>
    <mapping resource="com/montoya/orm/Categories.hbm.xml"/>
    <mapping resource="com/montoya/orm/Orders.hbm.xml"/>
    <mapping resource="com/montoya/orm/Products.hbm.xml"/>
    <mapping resource="com/montoya/orm/Suppliers.hbm.xml"/>
    <mapping resource="com/montoya/orm/Shippers.hbm.xml"/>
    <mapping resource="com/montoya/orm/Customers.hbm.xml"/>
  </session-factory>
</hibernate-configuration>

.Net Version

<?xml version="1.0" encoding="UTF-8"?>
<hibernate-configuration xmlns="urn:nhibernate-configuration-2.2"> 
  <session-factory name="Montoya.Core.Test">
    <property name="connection.provider">NHibernate.Connection.DriverConnectionProvider</property>
    <property name="show_sql">true</property>
    <property name="connection.driver_class">NHibernate.Driver.OracleClientDriver</property>
    <property name="connection.connection_string">Data Source=testDB;User Id=system;Password=xxx;</property>
    <property name="dialect">NHibernate.Dialect.Oracle10gDialect</property>
    <property name="proxyfactory.factory_class">NHibernate.ByteCode.Castle.ProxyFactoryFactory, NHibernate.ByteCode.Castle</property>
    <mapping assembly="Montoya.Core"/>
  </session-factory>
</hibernate-configuration>

3. Configure Hibernate Session

Java Version

public class HibernateUtil {
    private static final SessionFactory sessionFactory;

    static {
        try {

            sessionFactory = new AnnotationConfiguration().configure().buildSessionFactory();
        } catch (Throwable ex) {
            // Log the exception. 
            System.err.println("Initial SessionFactory creation failed." + ex);
            throw new ExceptionInInitializerError(ex);
        }
    }

    public static SessionFactory getSessionFactory() {
        return sessionFactory;
    }

    public static Session getSession()
    {
        return getSessionFactory().openSession();
    }
}

.Net Version

NHibernate.Cfg.Configuration cfg = new Configuration();
cfg.Configure();

ISessionFactory sessionFactory = cfg.BuildSessionFactory();
ISession session = sessionFactory.OpenSession();

Unit Testing & Mocking with Easy Mock

2009-10-04T04:36:00.001+03:00

If you are a fresh graduate worker for a corporate company ,probably all dirty jobs that effect whole system are assigned to you. With an afraid of changing the code, you read the code to find out where will be effected. Especially legacy systems can be so sophisticated that changing a piece of code, can make the whole system down in a second.

Testers, developers, project managers and customers do testing but the way of their tests are different. In this post i will not tell how you can test whole system as a single entity, in direct contradiction I'm going to tell how you can test individual classes, methods by unit testing and dependent objects by mocking.

Eclipse provides jUnit as a default testing framework for developers to write test codes in a little time by defining just simple annotations. Fundamentally, JUnit provides three annotations; @setup which prepares pre testing conditions, @Test which defines Service UnderTest, @After which prepares postConditions of the test.

To demostrate how it works, firstly i developed a single math class and a add method.
public class Math
{
    public int add(int a, int b)
    {
        return a + b; 
    }
}
and wrote a three lines of code to test.

public class MathTest
{
    private com.demo.dao.Math sut = null; //Service Under Test (SUT)
    
    @Before
    public void setup()
    {
        this.sut = new com.demo.dao.Math();
        System.out.println("MathTest.setup()");
    }
    
    
    @Test
    public void Add()
    {
        int a,b;
        a = 10;
        b = 30;
        
        Assert.assertEquals(40, this.sut.add(a,b));
        System.out.println("MathTest.Add()");
        
        
    }
    
    @After
    public void tearDown()
    {
        this.sut = null;
        System.out.println("MathTest.tearDown()");
    }
    
}

So far so good. Think that days after days, you hire a new worker and assigned a issue to develop multiply function. Our worker will probably copy/paste the add code and will forget the change the + signal to *; If our dummy worker can write test code for this math class he will see that multiply method does not work as he expected.

This is the easiest way of describing testing but in complex architectures it is not simple as i told. Because test code is optional (it is not what the customer wants), most of the developers will just develop automated tests for single, simple tests to satisfy project manager.

As you understand Unit testing helps developers the test the functionality of a function and class. Mocking means moving sophisticated dependencies from test code. Instead of initializing some objects and binding these objects to other objects bore developers. By creating dummy mock objects, you make the class tend to be the object that the SUT needs. But be careful mocking is not for testing functionality of a SUT, it is for testing the dependency of SUT.

package com.demo.dao;

public interface IUser 
{
    public void setLoginDao(IUserLoginDao dao);
    public boolean login(String userName,String password);
}

package com.demo.dao;

public interface IUserLoginDao
{
    public boolean login(String userName,String password);
}

package com.demo.dao;

public class UserService implements IUser
{

    
    private IUserLoginDao userDao = null;
    
    @Override
    public boolean login(String userName, String password) 
    {
        return this.userDao.login(userName, password);
    }

    @Override
    public void setLoginDao(IUserLoginDao dao) 
    {
        this.userDao = dao;
        
    }    
}

Easy Mock

1. It' is proxy based, so it is used to imitate the real object that SUT needs

2. Just writing 3 lines of code you initialize the proxy object.

3. it is really easy.[http://www.jmock.org/easymock-comparison.html]

Why auto-shrink sucks

2009-06-15T15:17:00.001+03:00

The question is simple, why auto-shrink sucks. Before backing up your database, you maybe chose auto-shrink property on, to shrink your database and to empty your transaction log fiile. Auto shrink sucks because to shrink database it damages your database indexes. To Demonstrate create two tables, take backup the database which we create tables in with auto-shrink property on then look indexes fragmentation percentage.

Use BlogDb
go
if exists(select * from sys.tables where name = 'tbl_data')
    drop table tbl_data
go
create table tbl_data(id int identity, data varchar(255))
go
declare @i int;
set  @i = 1;
while (@i < 5000) 
begin
      insert into tbl_data values (replicate('a', 255));
      set @i = @i + 1;
end;
go

create index IX_dat on tbl_data(data)


alter index all on tbl_data rebuild 
go
select avg_fragmentation_in_percent, fragment_count FROM sys.dm_db_index_physical_stats (
      db_id ('BlogDb'), object_id ('tbl_data'), NULL, NULL, 'limited');

go

DBCC SHRINKDATABASE  (BlogDB)
go
select avg_fragmentation_in_percent, fragment_count FROM sys.dm_db_index_physical_stats (
      db_id ('BlogDb'), object_id ('tbl_data'), NULL, NULL, 'limited');

Here is the result. I Think you don’t use auto-shrink after this demonstration.

Asynchronous Database Applications – Asynchronous Triggers

2009-06-09T09:41:00.001+03:00

I always hate developing triggers cause, the transaction that SQL Server handles gets bigger by this way. For example let’s design a table which holds Video data like videoid,title,length status ..etc. When we want to insert a new row into Video table, if there is a trigger on this table the insertion time will increase so it will be a performance overhead. With the SQL Server 2005 Service Broker we can write asynchronous triggers which separates trigger’s unit of work’s transaction from insertion transaction

use BlogDB
go
--enable service broker
alter database BlogDB
    set enable_broker ;
go

if exists(select * from sys.procedures where name = 'procSuspendVideoClipFromQueue')
    drop proc procSuspendVideoClipFromQueue
go
CREATE PROCEDURE procSuspendVideoClipFromQueue
AS
SET NOCOUNT ON;
    DECLARE @Handle UNIQUEIDENTIFIER;
    DECLARE @MessageType SYSNAME;
    DECLARE @Message XML;

RECEIVE TOP (1)
    @Handle = conversation_handle,
    @MessageType = message_type_name,
    @Message = message_body

FROM [VideoQueue];

declare @videoId uniqueidentifier


IF(@Handle IS NOT NULL AND @Message IS NOT NULL)
BEGIN
    
     SELECT
         @videoId = tmpVideo.Column1.value('@VideoId', 'uniqueidentifier')  
            FROM @Message.nodes('/row') AS tmpVideo(Column1)

        exec procSuspendVideoClip @videoId

END
go

-- Create Message Type

CREATE MESSAGE TYPE [VideoMessage] VALIDATION = WELL_FORMED_XML;

GO

-- Create Contract

CREATE CONTRACT [VideoContract] ([VideoMessage] SENT BY ANY);

GO

CREATE QUEUE VideoQueue WITH ACTIVATION

(STATUS = ON, MAX_QUEUE_READERS = 1,

PROCEDURE_NAME = procSuspendVideoClipFromQueue,

EXECUTE AS OWNER);

GO

CREATE SERVICE [VideoService] ON QUEUE [VideoQueue] ([VideoContract]);
go

if exists(select * from sys.triggers where name = 'trgVideoStatus')
    drop trigger trgVideoStatus
go
CREATE TRIGGER trgVideoStatus ON Video AFTER INSERT,Update
AS
BEGIN

SET NOCOUNT ON;

DECLARE @MessageBody XML;

    if update(VideoStatusId)
    begin
        set @MessageBody = (SELECT VideoId FROM Inserted FOR XML RAW, TYPE);
        DECLARE @Handle UNIQUEIDENTIFIER;
        BEGIN DIALOG CONVERSATION @Handle
        FROM SERVICE [VideoService]
        TO SERVICE 'VideoService'
        ON CONTRACT [VideoContract]
        WITH ENCRYPTION = OFF;
        SEND ON CONVERSATION @Handle
        MESSAGE TYPE [VideoMessage](@MessageBody);
    end
END
GO

BOUN Seminar

2009-05-06T11:19:00.001+03:00

Following our seminar at Bilkent University, this weekend we will meet BOUN students. In my session i will discuss how to design web services, and how to implement service patterns. After my session, one of my best friends and my colleague Onur Şimşek will discuss how to implement these patterns in WCF.

SQL Seminar @Yıldız Teknik

2009-04-24T13:26:00.001+03:00

Special thanks to inettr, nedirtv and especially to people who will attend. In this seminar first session will be about how you can effectively search keywords that your customers want to find and retrieve data that are relavent. The fourth session will be about query optimization, indexing strategies and keynotes about SQL Server performance tunning.

Paging Algorithm for Webpages with SQL Server 2000 Compability

2009-03-21T20:29:00.001+02:00

use Northwind
go
if exists(select * from sysobjects 
where name = 'usp_GetCustomerByPageNumber')
    drop proc usp_GetCustomerByPageNumber 
go
create proc usp_GetCustomerByPageNumber
(
    @pageIndex int = 1
)
as
declare @rowCount int
set @rowCount = 10 * @pageIndex

CREATE TABLE #temp(
    [CustomerID] [nchar](5) NOT NULL,
    [CompanyName] [nvarchar](40) NOT NULL,
    [ContactName] [nvarchar](30) NULL,
    [ContactTitle] [nvarchar](30) NULL,
    [Address] [nvarchar](60) NULL,
    [City] [nvarchar](15) NULL,
    [Region] [nvarchar](15) NULL,
    [PostalCode] [nvarchar](10) NULL,
    [Country] [nvarchar](15) NULL,
    [Phone] [nvarchar](24) NULL,
    [Fax] [nvarchar](24) NULL,
)

set rowcount @rowCount 
insert into #temp
    select  * from Customers
        order by CustomerID desc

        
CREATE TABLE #temp2(
    [CustomerID] [nchar](5) NOT NULL,
    [CompanyName] [nvarchar](40) NOT NULL,
    [ContactName] [nvarchar](30) NULL,
    [ContactTitle] [nvarchar](30) NULL,
    [Address] [nvarchar](60) NULL,
    [City] [nvarchar](15) NULL,
    [Region] [nvarchar](15) NULL,
    [PostalCode] [nvarchar](10) NULL,
    [Country] [nvarchar](15) NULL,
    [Phone] [nvarchar](24) NULL,
    [Fax] [nvarchar](24) NULL,
)


insert into #temp2
    select top 10 * from #temp
        order by CustomerID asc

select * from #temp2 order by CustomerID desc        
set rowcount 0
drop table #temp2
drop table #temp

Another Server 2000 paging algorithm is on Pinal Dave’s blog which topic is SQL SERVER - T-SQL Paging Query Technique Comparison - SQL 2000 vs SQL 2005 .

I researched why set rowcount is slow, i found out that set rowcount sorts all the table’s rows in tempdb so be careful when you are using it.

Technorati Etiketleri: SQL Server,Paging,Performance Tunning

Bookmark Lookup and Included Columns

2009-03-21T14:01:00.001+02:00

Bookmark lookup uses clustered index to lookup the corresponding row in the table. It is something like, sql server optimizer says “hey i used the index you create on that column and i used clustered index to retrieve other columns you want me to get.”. Let me give an example

1.Create a table and insert some rows (Code sample is compatible with SQL Server 2008)

if exists(select * from sys.tables where name = 'tbl_tags')
    drop table tbl_tags
go
create table tbl_tags
(
    TagId            int not null identity(1,1) primary key    ,
    Name            varchar(255) not null                    ,
    [Description]    varchar(255) not null                    ,
    DLM                datetime not null default(getdate())
)    
go
declare @i int = 1000
while @i > 0
begin
    insert into tbl_tags(Name,Description) values(@i,'Description ' + CAST(@i as varchar(4)))
    set @i -=1
end

2. Create a non-clustered index on Name and retrieve rows by Filtering Name.

create nonclustered index IX_tbl_tags on tbl_tags(Name) with(maxdop = 8)
go
select Name,DLM from tbl_tags where Name = '1'

3. Look execution plan of this query, from the picture below you will see bookmark lookup.

4.Recreate index with using included columns, reexecute select statement and look execution plan

drop index tbl_tags.IX_tbl_tags
create nonclustered index IX_tbl_tags on tbl_tags(Name) include(DLM) with(maxdop = 8)
go
select Name,DLM from tbl_tags where Name = '1'

Technorati Etiketleri: Indexing,SQL Server,Performance Tunning

How Clustered index affects non-clustered indexes

2009-03-20T12:06:00.001+02:00

While i was reading Pinal Dave’s blog which is the one of the best blog about SQL Server , i read Effect of clustered index over non-clustered index. This post is variant of it.
A heap is a table without a clustered index. Creating non-clustered indexes on a heap does not provide benefits of using indexes.
Create a heap

if exists(select * from sys.tables where name = 'tbl_tags')
      drop table tbl_tags
  go
create table tbl_tags
(
    TagId    int not null ,
    Name    varchar(255)
)
go

Insert some rows

declare @i int = 1000

while @i > 0
begin
    insert into tbl_tags(TagId,Name) values (@i,cast(@i as varchar(4)))
    set @i -=1
end

Retrieve Row by filtering Name column

select * from tbl_tags where Name =  '1'

Execution Plan is the picture below

Secondly create non-clustered index on Name column

create nonclustered index IX_tbl_Tags on tbl_Tags(Name)
Again retrieve rows by filtering Name column and look execution plan

 







See it again Optimizer chooses table scan method to retrieve rows 

Now create a clustered index on Id column,retrieve rows by filtering Name column and look execution  plan

   create unique clustered index PK_tbl_tags on tbl_Tags(TagId)
   go                                    
   select * from tbl_tags where Name = '1'

As a conclusion from our observations every
non-clustered index needs 
clustered index internally. 

Technorati Tags: SQL Server,Optimization,Indexing

SQL Server 2008 FileStream

2009-03-19T02:11:00.001+02:00

Storing binary large objects in database is not a good idea because

Takes memory in SQL Server Buffer
BLOB data takes place in database file so it makes transaction log
No more then 2GB data can be stored as varbinary(max)
Updating BLOBs can cause fragmentation

FileStream

Has own transaction system so never causes to database own transaction file to grow abnormaly
Single File create/delete operation executed for filestream so fragmentation is not as much problem as varbinary(max)
In books online it writes that upto 1MB is optimal for stroing binary large objects but up to teched 2008 Bob Beauchemin it is optimal up to 256K

[1] Image 1

Demo

Create a table that has a column with varbinary(max)

use BlogDb
go
if exists(select * from  sys.tables where name = 'tbl_user_documents')
  drop table tbl_user_documents
go
create table tbl_user_documents
(
  DocumentId  int not null identity(1,1) primary key  ,
  Title    varchar(255) not null          ,
  Document  varbinary(max) not null          ,
  [Type]    varchar(5)    not null  
)

2. Insert Documents

using System;
using System.Collections.Generic;
using System.Data.SqlClient;
using System.IO;
using System.Linq;
using System.Text;
namespace DocumentUploader
{
  class Program
  {
    static void Main(string[] args)
    {
      string[] files = Directory.GetFiles(@"c:\Files");
      foreach(string file in files)
      {
        byte[] bytFile = GetFileBytes(file);
        InsertDocument(Path.GetFileName(file), bytFile);
      }
      
      Console.WriteLine("Finished");
      Console.ReadLine();
      
    }
    static void InsertDocument(string title,byte[] bytDoc)
    {
      using(SqlConnection con = new SqlConnection("data source=localhost;initial catalog=BlogDb;integrated security=sspi"))
      using (SqlCommand cmd = new SqlCommand("insert into tbl_user_documents(Title,Document,[Type]) values (@title,@doc,@type)",con))
      {
        cmd.Parameters.Add(new SqlParameter("@doc", bytDoc));
        cmd.Parameters.Add(new SqlParameter("@title", Path.GetFileNameWithoutExtension(title)));
        cmd.Parameters.Add(new SqlParameter("@type", Path.GetExtension(title)));
        con.Open();
        cmd.ExecuteNonQuery();
        con.Close();
      }
    }
    static byte[] GetFileBytes(string filePath)
    {
      byte[] bytFile = null;
      using(FileStream fs = new FileStream(filePath,FileMode.Open))
      {
        bytFile = new byte[fs.Length];
        fs.Read(bytFile, 0, bytFile.Length);
        fs.Close();
      }
      return bytFile;
    }
  }
}

4. Configure Database Server for FileStream

5. Configure Database for FileStream

--add filegroup for FileStream
alter database BlogDb
  Add FileGroup FileStreamFileGroup1 contains FileStream
go
--Add FileGroup To Database
alter database BlogDB
  add file
  (
    name = 'UserDocuments'  ,
    filename = 'C:\FileStream\UserDocuments' 
  ) to filegroup FileStreamFileGroup1
go

6. To get benefit of using filestream add rowguid column, and filestream typed data column

ALTER DATABASE BlogDb Set Read_Committed_snapshot off
--add filegroup for FileStream
alter database BlogDb
  Add FileGroup FileStreamFileGroup1 contains FileStream
go
--Add FileGroup To Database
alter database BlogDB
  add file
  (
    name = 'UserDocuments'  ,
    filename = 'C:\FileStream\UserDocuments' 
  ) to filegroup FileStreamFileGroup1
go
  
alter table tbl_user_documents set(filestream_on ='default')
go
alter table tbl_user_documents
  add 
  
    [Document2] varbinary(max) filestream  null  ,
    FileId  uniqueidentifier  not null rowguidcol unique default (newid())
go

7. Update Document2 to Document ,Drop Document and rename Document2 to Document

update tbl_user_documents
  set Document2 = Document
go
alter table tbl_user_documents
  drop column  Document
sp_rename  @objname = N'BlogDB.dbo.tbl_user_documents.Document2',
      @newname = N'Document'  ,
      @objtype = N'COLUMN'

8. Create Fulltext Index on only Document Column

9. Now we’ve been started to use fulltext index on FileStream

select * from tbl_user_documents t
  inner join containstable(tbl_user_documents,Document,'"*Microsoft*"') c
    on c.[Key] = t.DocumentId
      order by c.[Rank]

References

[1] http://msdn.microsoft.com/en-us/library/cc949109.aspx

[2] Teched – 2008 Bob Beauchemin – SQL Server 2008 FileStream

Technorati Etiketleri: FileStream,SQL Server 2008,SQL Server,Full-text Search,Full-text Indexing