Thursday, May 24, 2007

Slaying the Six-Headed SOA Beast

For the past several years people have been hearing about Service Oriented Architecture through various mediums across the internet.  Most of what you would read would be academic material that was difficult to think about in concrete terms.

Still today there are numerous articles and books on the subject that talk so much in theory that there isn’t enough good direction on where to go.  For Joe Developer at Company XYZ, how can he take advantage of these seemingly great ideas on his next .NET (or whatever) project?

Unfortunately, this lack of good direction has led to a misconception about what SOA is and how it should be implemented.

At its heart, SOA is the next evolution of development.  Just as we had objects to encapsulate our behavior and compose applications of objects, we now can encapsulate core functionality as services so that they are reusable across the enterprise, or even to our customers. 

We can also take these services and compose them to create more complex services, and this can be taken to the extreme where you model every process that the business performs as a service.  The idea is that new applications can be built without the need to deal with implementation, it can be done completely by composing services.  Want to change the way the business functions?  Rewire the business process services in a way that better suits the business.

Unfortunately, when you talk this high level, you often gloss over the technical guidance and people take the advice and run in any direction.  It’s like a scavenger hunt where the treasure map is handed out and it contains details about the glorious treasure, but not the direction on how to get there.

This also leads to the misconception that SOA == Web Services, which is not the case.  More on this in a minute.

So back at Company XYZ, Joe Developer is implementing his next project with an SOA.  His management has also read about SOA and knows that it’s the right thing to do.  In fact, they may even be pushing him in this direction.  He creates his business logic, he creates his UI.  Next comes the service layer.  Joe thinks to himself, what better way to implement services than to be the first consumer!  It will be perfect!  Then any new application can access the functionality and everything will be great.  I’ll have an SOA Seal of Approval on my app because I used web services and my management will be happy.  And my application will be unnecessarily SLOW.  And complicated.  For no reason.

The reality is that Web Services are meant for interoperability.  They are meant to be accessed across a variety of mediums and ports.  They are great for platform interoperability and cross-political communication between applications.  They are not suitable for inter-company, .NET to .NET interaction.  The overhead of WSDL, SOAP, XML, etc is wasted in this scenario.  Consuming a web service is not efficient.  To combat this overhead, it is advised to make your remote calls as coarse-grained as possible.  Chatty remote calls will kill an applications performance.  So now we are designing our (!) application around the limitation of a heavyweight service layer.

This is something that I see all too often.

UI
SERVICE AGENTS
WEB SERVICE LAYER
BUSINESS LOGIC LAYER
DATA ACCESS LAYER

 
A better solution would be to design your application the way that good software engineering principles have taught you.  Separate responsibilities.  Create a domain model that represents your problem domain.  Speak in terms of your domain.  Leverage object oriented programming.

Then, when management decides that the functionality that you have created would be suitable to expose outside the company, or to their Java project that is currently underway, you can introduce a service layer.  The service layer consumes your existing business logic layer.  The idea is to introduce a more coarse-grained interface suitable for remote calls.  You create Data Transfer Objects that aggregate your domain objects and are more stable for a service contract.

This is a much better approach, because we take into account the fact that we can expose the functionality of services, but we should not shoot ourselves in the foot to do so.

Now getting back to the misconception of SOA == Web Services.  Why is this so common to see?  First, the term Web Services is probably partially to blame.  A service can be native .NET code, it can be a remoting interface, it can be SOAP over HTTP.  A more effective service oriented architecture (especially one within an application) is achieved by choosing the best medium for the circumstances.

I think it’s time for an example.  Say we are writing an application that calculates massive financial data for our enterprise.  One component of this will calculate the exchange rate for many currencies.  Ignoring the specifics of the implementation, how should we reuse this component so that the entire enterprise can access it?  We want to take advantage of a plain .NET to .NET inter-process call because it’s the fastest.  We’d also like to expose this to other .NET applications within our corporation.  Finally we want to use this service in our Java system as well.  How can we accomplish all of these without just resorting to the lowest common denominator?

One of the great things that I learned while studying Enterprise SOA in Paris was what the IBM guys call a Service Component Architecture, or SCA.  This architecture is enables services to be composable.   The WebSphere Integration Developer emphasizes modeling all of your business processes as composable services.  Most of these will be Java to Java calls, but some may not.  What they do is have you design your interface using a GUI, which spits out the WSDL interfaced and the Java interface.  The best flavor of interface is chosen depending on the circumstances.

So we can solve the above problem by having one single interface, with both a .NET and WSDL versions.  The configuration can determine which is used to achieve the best results.

Hopefully I’m not leaving out some core SOA concepts (I’m sure I am).  What about you?  Do you see too many mis-uses of SOA like I do?  What other techniques can help bring the industry back to reality?

(I also must apologize for such a long-winded post.  My bus is stuck on an HOV lane (one single lane with walls) in rush hour traffic.  I’ve been here for over an hour already.)

Tags:
Tuesday, May 22, 2007

Dubbelbock TFS

I have gone on record and said before that TFS Source Control is a great step up from VSS, however I’d never want to be constrained to the IDE for my SCC tasks.  Granted, IDE integration is a nice feature, but it shouldn’t be your sole interface.

This is part of the reason that I love Subversion.  It has builtin command line support for the freaks out there (like me) who like to type.  TortoiseSVN gives us explorer integration, which is solid gold.  Then there’s AnkhSVN for the IDE integration.  See a pattern here?

So I just stumbled on a new TFS Source Control explorer plugin tool with a funny name.  It’s called Dubbelbock TFS and it was written by a friend of mine, Ben Day.

This is the kind of tool that will help bring the power of TFS source control out of the IDE and enable a much more usable and powerful experience.

So go out and buy a copy, it’s only $25 (I think).  And tell Ben I sent you.

Upgrade Issues Resolved

I think I have the upgrade issues resolved.

Hopefully now the comments will work!

Wednesday, May 16, 2007

Pardon The Dust

My blog has received a long overdue face-lift.

I was getting a little tired of the previous black background design and wanted something cleaner.  I also upgraded to dasBlog 1.9, which proved to be more than just a walk in the park.  Things are still a little broken around here, but I will get it resolved sooner or later.  I hope you don’t mind a few broken links and things while I settle this new design in.

During all of this I was really pondering switching to Subtext.  It seems like a equivalent stature blogging enging on the ASP.NET 2.0 platform, however it supports databases.  Das Blog is all about the file system, which makes it easy for people to host if they don’t have access to a database.  But since I have over 2 years of content up here, not only does it take a long time to transfer over ftp, but when I upgrade I cannot simply copy files over.  I have to be very careful and selective and I usually end up messing up something.  (This is why I always back it up before I start).

I know that database support is on the roadmap for Das Blog, but I don’t know how long it will be.  We shall see.

Until then, enjoy the new design .  Please let me know what you think in the comments!

Tags:
Monday, April 23, 2007

Paris - Day 1

My company, Sogeti, has sent me to the beautiful county of France to attend a global enterprise SOA training from some of the folks at IBM.

So far, France is absolutely gorgeous.  I braved the subway system with my friend Aaron Murrell, which was very humorous.  We got a bit turned around a few times, but we eventually found our stop.

Streets of Paris

old building

We noticed that people park crazy in Paris…

Smart car parking job

We went into Paris and tried to find a restaurant called Chartier, however we couldn’t locate the street.  A quaint restarant called Le Flash caught our eye and we walked in.  The owner greeted us with many french words (which I do not understand) and we had a fun time ordering our food and communicating with him.  The food was excellent, the beer was even better, and the owner even played Alan Jackson for us, ha!  I don’t care for country music, but it was funny and appreciated nonetheless.

Le Flash

We then took a taxi north to the city of Gouvieux where the corporate chateau resides.  It really is breath-taking.  It was built by Eiffel a long time ago, and is now home for our Capgemini University (well, the bar and dining area, that is).

Le Chateau

We start our training tomorrow and I’m sure our day will be full of introductions and hands-on training.

 

Tags: ,
Thursday, April 19, 2007

Review - Agile Principles, Patterns, and Practices in C#

Robert Martin has a great book here.  I just finished reading Agile Principle, Patterns, and Practices in C# (what a mouthful!). 
 
In this book you get a fantastic play-by-play of a typical TDD/pairing session, which I think is a great way to demonstrate the process. 
 
This was also the book that really got me to appreciate UML for what it is.  I'm typically the guy who knows the UML basic shapes, and draws a bunch of interconnected rectangles on a whiteboard to help me solve problems.  I was never a "fan" of UML because I always associated it with the monolithic CASE tools that use UML as the source for an architecture, and out spits generated code.  The book described what Martin feels are the essential (read: useful) components of UML and really abandons the rest.  He emphasizes throwing away your diagrams when you're done and encourages writing them on a napkin or a whiteboard, which is infinitely faster than, say, Visio.
 
The section on patterns is well written, and it is always nice to get refreshers on patterns that you might not know about or haven't used recently.  Again he emphasizes not to go crazy with patterns.  They are there when they help, but don't be shy about throwing them out when they complicate things.  Indeed, this book is agile.
 
The final section (or rather 1/3 of the book!) goes about a payroll system.  He does a bit of UML to get the basic idea in his head and then he goes straight to the tests.  He fleshes out the entire thing, right there in the text.  The model changes, the tests drive the design and behavior, and he frequently consults with his "Customer" (himself) over what the requirements are.  After he has a working model that is fully tested, he bolts on persistence using a custom ADO.NET pproach, which is difficult.  Seeing him do this reminds me of how I like to use NHibernate, but I found it difficult to repeat this approach using flat ADO.NET calls.
 
I'm thoroughly impressed with this book.  If any of the topics above interest you, then go pick it up!
Wednesday, April 18, 2007

TargetProcess - First Impressions are Everything

I ran across a link to TargetProcess today and I thought I’d check it out.  All I knew about it was that it is some kind of “agile tool.”

I visit the website and it looks promising.  Clean graphics, simple usable navigation:

Team Proces Home pageAll I want to do is see what it is, what it looks like, and whether I think that it’s worth investigating further.  With my typical attention span, a given product better impress me within 15-30 seconds, otherwise I’m off to do something more productive.  First impressions are everything.  The last thing you want to do is waste a potential customer’s time.

 

So I click on See.  I’d rather see some screenshots than try a demo.  The first option on that small page is Try the Demo.  Umm, okay I’ll try the demo then.  The demo page says that any username and password will work.  Great, that will save me time and not get in my way.  I click on the demo.

 It asks me to submit my name, company, and email address.  I enter in random garbage.  (At this point they don’t deserve my info because I don’t know yet if I’m interested!  I can understand that they want some usage information and the ability to generate leads, but come on!  Wait until I’m excited first!).  The email address needs to be validated.  I change asdf to asdf@aol.com.

 Ah, finally the demo (1 minute 30 seconds after I initially viewed their page).  I try to login with my standard set of credentials:  asdf/asdf.

 ERROR.

  error logging in

Hrm, and exception was thrown while logging in.  Not a good sign.  At least they were nice enough to let me notify them without opening my email client.  I click on the Notify Support button.

ERROR.

Error sending email. 

At this point I am thoroughly annoyed.  I have wasted about 3 minutes (now more like 10 since I felt the need to write this blog post J ).

 I eventually went back and looked at the screenshots and ended up a little intrigued.  I saw what the app looks like, I saw how it allows me to manage an agile project and collect the information and display the metrics I am likely to care about.  Really the screenshots were their best sales tactic, not the online demo.

 Hopefully they will fix this soon so that other potential buyers won’t shy away from their product too early.  It would be a shame because it looks like a useful tool.

 The bottom line:  Your customers are impatient.  Don’t waste their time.  Don’t shoot yourself in the foot with a live demo if the live demo doesn’t work.

UPDATE:  I was able to figure out from the error that the issue is a unique value violation.  Apparently a lot of people type in a username of ‘asdf.’  Type in a unique name and it will work.

 

Wednesday, April 11, 2007

My Presentation on ORM with NHibernate

A couple of weeks ago I gave a presentation on Object Relational Mapping with NHibernate.

We talked about:

  • Basic Concepts
  • Getting Started, watching what SQL gets generated for various actions
  • Architecture, querying, etc
  • A live Blog example done with TDD

A number of people came and watched me drown in code, but I think all-in-all it was a good time and I think I conveyed a lot of information in a small time-frame.

Anyway, I recorded the presentation.  You can download it below.  You will need the TechSmith Video Codec to view it.

A few times I was asked questions by the audience and I didn’t repeat the question, so hopefully you will be able to infer a bit. 

I’d appreciate your feedback if you watch it, it’s about 1 hour and 45 minutes (ouch!).

File Attachment: ORMWithNHibernateScreenCast.wmv (64824 KB)

 

Credit - Loans - Loan - Credit Counseling