Skip to main content

Posts

Showing posts with the label hadoop

Hadoop Hive Session issue in weblogic data source

Hi Everyone, Recently i come with a requirement about Hadoop Hive integration in Oracle SOA, For same i wrote a blog which you can find on below link. https://oraclesoaosbbpmapi.blogspot.com/2019/03/hadoop-hive-data-base-fetching-records.html After successfully configuring hive in weblogic, We faced a new issue which is about connection. Before going deep about issue and solution let's see how HIVE DB manage connection on server side. when ever we make a data base connection for HIVE DB, it create an internal session and generates a session id which is valid for a specific period of time which is configured on server level. After that period of time Hive create a new session id and process the query. How weblogic data source manage connection: When we create a data source in weblogic, We define a connection pool size by which we can use existing connections which are not in use by any other resource by which weblogic minimize the connection cost. Issue due to...

Hadoop Hive Data Base Fetching records in Oracle SOA

Hi Everyone, Today we are going to see how we can execute a Select statement in Hadoop Hive data base using oracle soa DB adapter. Before going into configuration & deployment steps, One thing oracle SOA/Weblogic does not have default built in support to connect over HIVE DB, to full fill same we have to use external JAR's of hadoop hive which will be configured in oracle weblogic. Following is list of JAR's which will be used inside configuration. hive-jdbc-1.2.1-standalone.jar hadoop-common.jar JDev configuration for Data base connection: Click on Driver Class "Add button". Driver class:org.apache.hive.jdbc.HiveDriver Libaray: Add Jar "Hive-jdbc-1.2.1-standalone" Add class path for both jar. Check Connection Status, If you have configured JAR correctly with exact version number of DB. It will work. SOA Project configuration: Create one SOA application. Drag & Drop DB adapter You can't use standard impl...