VMware offers training and certification to turbo-charge your progress.Learn more
We are pleased to announce the Spring for Apache Hadoop 2.3 M1 milestone release.
The most important enhancements in the Spring for Apache Hadoop 2.3 M1 version:
See the release changelog for details.
To be able to use Hive 1.x which dropped support for HiveServer1 and the corresponding Thrift client we had to rewrite the Hive support in Spring for Apache Hadoop. We now support HiveServer2 using the JDBC client and for the most common uses you only need to change the client configuration to use a hiveDataSource. Here is an example:
<hive-client-factory id="hiveClientFactory" hive-data-source-ref="hiveDataSource"/> <beans:bean id="hiveDriver" class="org.apache.hive.jdbc.HiveDriver"/> <beans:bean id="hiveDataSource" class="org.springframework.jdbc.datasource.SimpleDriverDataSource"> <beans:constructor-arg name="driver" ref="hiveDriver"/> <beans:constructor-arg name="url" value="jdbc:hive2://localhost:10000"/> </beans:bean>
If you used the
org.apache.hadoop.hive.service.HiveClient directly in your code you need to switch to use the new
org.springframework.data.hadoop.hive.HiveClient which mimics the old Thrift based client but uses the JDBC driver to communicate with the HiveServer2.
The changes that we made to the Spring for Apache Hadoop Hive example code can be seen in this commit.
We continue to provide version specific artifacts with their respective transitive dependencies in the Spring IO milestone repository:
Please provide feedback so we can prioritize the work on new features scheduled for 2.3 (see previous blog post for a list) and any additional feature requests. You can use JIRA issues or GitHub issues (see project page for links).
The project page is at - http://projects.spring.io/spring-hadoop/