Today we are pleased to announce the 1.0 M1 release of Spring XD  (download).Spring XD is a unified, distributed, and extensible system for data ingestion, real time analytics, batch processing, and data export.  The project’s goal is to simplify the development of big data applications.

From the 10,000 foot view, big data applications share many characteristics with Enterprise Integration and Batch applications.  Spring has provided proven solutions for building integration and batch applications for more than 6 years now via the Spring Integration and Spring Batch projects.  Spring XD builds upon this foundation and provides a lightweight runtime environment that is easily configured and assembled via a simple DSL.

In this blog we will introduce the key components of Spring XD, namely Streams, Jobs, Taps, Analytics and the DSL used to declare them, as well as the runtime architecture.  Many more details can be found in the XD Guide.

Streams

A Stream defines how data is collected, processed and stored or forwarded.  For example, a stream may collect syslog data, filter it, and store it in HDFS.  Spring XD provides a DSL to define a stream.  The DSL allows you to start simple using a UNIX pipes-and-filters syntax to build a linear processing flow but lets you also describe more complex flows using an extended syntax.

Sources and Sinks

A simple linear stream consists of the sequence: Input Source, (optional) Processing Steps, and an Output Sink.  As a simple example consider the collection of data from a HTTP Source writing to a File Sink. The DSL to describe this stream is

http | file

You tell Spring XD to create a stream by making a HTTP request to the XD Admin Server which runs on port 8080 by default.  In the M2 release we will provide an interactive shell to communicate with XD, but for M1 the easiest way is to interact with XD is using ‘curl’.

curl -d "http | file" http://localhost:8080/streams/httptest

The name of the stream is httptest, the default HTTP port to listen on is 9000, and the default file location is /tmp/xd/output/${streamname}.

If you post some data on port 9000 with curl

curl -d "hello world" http://localhost:9000

You will see the string hello world inside the file /tmp/xd/output/httptest

To change the default values, you can pass in option arguments

http --port=9090 | file --dir=/var/streams --name=data.txt

The supported sources in M1 are file, time, HTTP, Tail, Twitter Search, Gemfire (Continuous Queries), Gemfire (Cache Event), Syslog and TCP.  The supported sinks are Log, File, HDFS…

Dear Spring Community,

I am pleased to announce that Spring Data MongoDB 1.0 RC1 is now available!

The primary goal of the Spring Data project is to provide a familiar and consistent Spring-based programming model for new datastores while retaining store-specific features and capabilities. The Spring Data MongoDB project provides integration with the MongoDB document database. Key functional areas are a POJO centric model for interacting with a MongoDB DBCollection and easily writing a Repository style data access layer.

This is primarily a bug fix release as we move quickly to GA but a few…

        <br>

Dear Spring Community,

We are pleased to announce that Spring .NET 1.3.0 is now available.  

Download | Support | Documentation |  Community

This release contains the following new major features:

• Micosoft Test Framework integration - Integration test classes to support MSTest in addition to NUnit.
• TIBCO EMS integration - Helper classes to increase your productivity developing messaging based applications with TIBCO EMS.
• NVelocity integration - Helper classes to configure a NVelocity template engine in a Spring based application
• VS.NET Solution Templates - VS.NET 2008 based…

        <br>

Dear Spring Community,

We are pleased to announce that Spring .NET 1.3.0 is now available.  

Download | Support | Documentation | Community

This release contains the following new major features:

• Micosoft Test Framework integration - Integration test classes to support MSTest in addition to NUnit.
• TIBCO EMS integration
  • Helper classes to increase your productivity developing messaging

  based applications with TIBCO EMS.

• NVelocity integration - Helper classes to configure a NVelocity template engine in a Spring based application
• VS.NET Solution Templates
  • VS.NET 2008 based solution templates to get you up and running
  …

We are pleased to announce that Spring for .NET 1.2.0 is now available.

Download | Support | Documentation| Community

This release contains the following new major features:

• WCF integration - Configure WCF services using dependency injection. Apply AOP advice to WCF services.
• MSMQ integration - MSMQ helper classes to increase your productivity developing messaging applications. Provides integration with Spring's transaction management features.
• Apache ActiveMQ integration - Helper classes to increase your productivity developing messaging applications with ActiveMQ/NMS
• Quartz integration - Configure Quartz jobs, schedulers, triggers using dependency injection. Convenience classes for implementing Quartz Jobs.
• AOP- New inheritance based AOP proxy generation
• NHibernate 2.0.1 support.

This release includes approximately 100 bug fixes and enhancements since the 1.1.2 release.

Please refer to the changelog for additional details.

Enjoy!

We are pleased to announce that Spring .NET 1.2.0 RC1 has been released.
Download | Support | Documentation | Changelog
This release contains the following features:

• WCF Integration - Configure WCF services using dependency injection. Apply AOP advice to WCF services.
• MSMQ integration - MSMQ helper classes to increase your productivity developing messaging applications. Provides integration with Spring's transaction management features.
• Apache ActiveMQ integration - Helper classes to increase your productivity developing messaging applications with ActiveMQ
• Quartz integration - Configure Quartz jobs, schedulers, triggers using dependency injection. Convenience classes for implementing Quartz Jobs and integration with Spring's transaction management features.
• AOP New inheritance based AOP proxy generation.
• Performance Improvements in WebForm dependency injection.
• NHibernate 2.0.1 support.

Other notable new features in 1.2.0 RC1

• Color code and XML listings in reference documentation.
• Introduction of sterotype attributes - for example [Repository] 
• WCF Service exporter.
• Extensible web navigation.
• New QuickStart applications are available for WCF, Quartz, MQMQ, and Apache Active MQ integration.

Support for TIBCO EMS, Websphere MQ, and Progress SonicMQ will be made available commerically.  Contact sales for more information.

Please refer to the changelog for additional details.

Enjoy!

The CommonServiceLocator project was released this week on CodePlex with the general idea of providing an IoC container agnostic API for resolving dependencies using Service Location. Erich Eichinger from SpringSource contributed the Spring.NET implementation, thanks Erich!

Here is the API so you get the basic idea public interface IServiceLocator : System.IServiceProvider {

object GetInstance(Type serviceType); object GetInstance(Type serviceType, string key); IEnumerable