SQL loader loading data from legacy to Oracle

Similar Questions

• Loading data from SQL to Essbase table

  Hello

  I'm loading data from SQL to Essbase table by using a rules file. Number of rows in the source table is 7 million. I use the SUNOPSIS MEMORY ENGINE as area transit, LKM SQL for SQL and SQL IKM for Hyperion Essbase (DATA).

  Question:

  1 can I not use any other LKM as MSSQL for MSSQL (PCBS) to load data to the staging instead of LKM SQL for SQL? What I have to change the transit area then? Loading data using LKM SQL for SQL seems quite slow.

  2 it is mandatory to use LKM SQL for SQL, can someone please tell me what I can change to make this quick support parameters?

  3. is it compulsory to use the SUNOPSIS MEMORY engine loading data from SQL server to Essbase?

  Thank you...

  (1) Yes, I highly recommend watching using a KM which uses native as database technology these will usually be more efficient than the generic (like LKM SQL for SQL) KM especially when large volumes of data are involved. Your staging will change depends on where you organize data for example if you are using a SQL server specific KM as - MSSQL for MSSQL (PCBS) - you must have a lay-by available on a MSSQL database and have access to the utility of PCBS.

  (2) it is not mandatory to use this KM you can use a KMs supported by your database technology

  (3) it is absolutely not obligatory to use the SUNOPSIS MEMORY engine. This should only be used when you have relatively small amounts of data, as well as all the processes in memory, or in the case where you have no other relational technology to perform the staging on. However, in your case to use wherever you are processesing these large volumes of data you should be staged on a physical such as SQL Server or Oracle database if they are available.

• Error loading data from Oracle 10 g to Excel

  Hello gurus,
  
  I get the error when loading data from the Oracle 10 g database table to Excel.
  I use SQL TO ADD SQL IKM.
  Staging area is different from the target and I use the same pattern sense to source and put in scene.
  Please help me...
  
  Error is
  
  0: S1000: sun.jdbc.odbc.JdbcOdbcBatchUpdateException: [Microsoft] [ODBC Excel Driver] operation must use an update query.
  sun.jdbc.odbc.JdbcOdbcBatchUpdateException: [Microsoft] [ODBC Excel Driver] operation must use an update query.
  
  at sun.jdbc.odbc.JdbcOdbcPreparedStatement.emulateExecuteBatch (unknown Source)
  
  at sun.jdbc.odbc.JdbcOdbcPreparedStatement.executeBatchUpdate (unknown Source)
  
  at sun.jdbc.odbc.JdbcOdbcStatement.executeBatch (unknown Source)
  
  at com.sunopsis.sql.SnpsQuery.executeBatch (SnpsQuery.java)
  
  at com.sunopsis.dwg.dbobj.SnpSessTaskSql.execCollOrders (SnpSessTaskSql.java)
  
  at com.sunopsis.dwg.dbobj.SnpSessTaskSql.treatTaskTrt (SnpSessTaskSql.java)
  
  at com.sunopsis.dwg.dbobj.SnpSessTaskSqlI.treatTaskTrt (SnpSessTaskSqlI.java)
  
  at com.sunopsis.dwg.dbobj.SnpSessTaskSql.treatTask (SnpSessTaskSql.java)
  
  at com.sunopsis.dwg.dbobj.SnpSessStep.treatSessStep (SnpSessStep.java)
  
  at com.sunopsis.dwg.dbobj.SnpSession.treatSession (SnpSession.java)
  
  at com.sunopsis.dwg.cmd.DwgCommandSession.treatCommand (DwgCommandSession.java)
  
  at com.sunopsis.dwg.cmd.DwgCommandBase.execute (DwgCommandBase.java)
  
  at com.sunopsis.dwg.cmd.e.i (e.java)
  
  at com.sunopsis.dwg.cmd.g.y (g.java)
  
  at com.sunopsis.dwg.cmd.e.run (e.java)
  
  at java.lang.Thread.run (unknown Source)
  
  
  Kindly help me...
  
  Thanks in advance.
  
  Samuel

  Hello

  When you created the DSN for the spreed excel worksheet you dot not uncheck the read-only box.
  Make sure that the read-only checkbox is not checked, otherwise you will get an error message when trying to insert data into the Excel worksheet (error: "[Microsoft] [ODBC Excel Driver] operation must use an update query.").

  Thank you
  Fati

• SOS! -Error to load data from Oracle 11 g to Essbase using ODI

  Hi all.
  
  I want to load data from oracle database to essbase using ODI.
  I have set up correctly the Hyperion essbase physical and logical topology manager and got the structure ESSBASE BASIC app DEMO.
  The problem is.
  1. when I try see data right click on the table of essbase.
  va.sql.SQLException: driver must be specified
  at com.sunopsis.sql.SnpsConnection.a (SnpsConnection.java)
  at com.sunopsis.sql.SnpsConnection.testConnection (SnpsConnection.java)
  at com.sunopsis.sql.SnpsConnection.testConnection (SnpsConnection.java)
  at com.sunopsis.graphical.frame.b.jc.bE (jc.java)
  at com.sunopsis.graphical.frame.bo.bA (bo.java)
  at com.sunopsis.graphical.frame.b.ja.dl (ja.java)
  to com.sunopsis.graphical.frame.b.ja. < init > (ja.java)
  to com.sunopsis.graphical.frame.b.jc. < init > (jc.java)
  I got the answer of partisan Oracle it's ok, just omit it. The second problem will appear.
  2 create an interface between the oracle and essbase database, click on the option ' staging of deffirent from the area of the "(ce qui signifie que la mise en scène est créé à la base de données oracle) target, and using IKM SQL for Hyperion Essbase (metadata), run this interface".
  
  org.apache.bsf.BSFException: exception of Jython:
  Traceback (innermost last):
  "< String >" file, line 61, in there?
  com.hyperion.odi.essbase.ODIEssbaseException: invalid value specified [RULES_FILE] for the load option [null]
  
  at com.hyperion.odi.essbase.ODIEssbaseMetaWriter.validateLoadOptions (unknown Source)
  
  at com.hyperion.odi.essbase.AbstractEssbaseWriter.beginLoad (unknown Source)
  
  at sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
  
  at sun.reflect.NativeMethodAccessorImpl.invoke (unknown Source)
  
  at sun.reflect.DelegatingMethodAccessorImpl.invoke (unknown Source)
  
  at java.lang.reflect.Method.invoke (unknown Source)
  
  at org.python.core.PyReflectedFunction.__call__ (PyReflectedFunction.java)
  
  at org.python.core.PyMethod.__call__ (PyMethod.java)
  
  at org.python.core.PyObject.__call__ (PyObject.java)
  
  at org.python.core.PyInstance.invoke (PyInstance.java)
  
  to org.python.pycode._pyx1.f$ 0 (< string >: 61)
  
  to org.python.pycode._pyx1.call_function (< string >)
  
  at org.python.core.PyTableCode.call (PyTableCode.java)
  
  at org.python.core.PyCode.call (PyCode.java)
  
  at org.python.core.Py.runCode (Py.java)
  
  at org.python.core.Py.exec (Py.java)
  
  
  
  I am very confused by it. Someone give me a solution or other docs.
  
  Ethan.

  Hello

  You say that you are loading, but you chose the KM for the loading of metadata?
  If you load metadata then you must provide a rules file, if you are loading and then choose the KM - IKM SQL for Hyperion Essbase (DATA)

  Ok?

  See you soon

  John
  http://John-Goodwin.blogspot.com/

• How to load data from ms sql to the by the file rules and maxl essbase

  Hi, everybody!
  Pretty Shure the kind of topic exists already on the forum, but unfortunately can't find it.
  
  I want to understand, how to load data from the database to ms sql for the PB of essbase application.
  
  (I) so I have:
  1. a request for 'society '.
  2 and its database 'Plan '.
  3. with simple outline, which contains only two dimensions:
  
  -The time period < 1 > (Label only)
  -Total year (~)
  -Qtr1 (+)
  Jan (+)
  Feb (+)
  Mar (+)
  -Qtr2 (+)
  APR (+)
  May (+)
  Jun (+)
  
  -Accounts < 1 > (Label only)
  -Lost / based (~) (Label only)
  -Revenues (+)
  L1.1 (+)
  L1.2 (+)
  -Costs (-)
  L2.1 (+)
  L2.2 (+)
  
  (II) also, I created a rules file called "CO_DWH" and associated with this schema
  It (Rules file) a 3 columns:
  Data of the 'period', 'account '.
  
  There is also the option checked "load data".
  
  (III) in MS SQL Server, I have a database of "hypdb" and "essadmin" with "password" login
  
  (IV) I executed my bat file:
  C:\Hyperion\EssLoad.bat
  There is only one line:
  
  EssLoad.bat-
  startMaxl.cmd EssLoad.txt
  ----------------------------------------------
  
  EssLoad.txt-
  login password admin on erpserver;
  Import database data Company.Plan connect in essadmin password using the server rules_file 'CO_DWH' error abort;
  disconnection;
  "exit";
  --------------------------------------------
  
  
  All plans that I copied well worked ERP system, but I don't understand, this is exactly table in the MS SQL database, data loading to essbase db?

  TOU have to do a few things
  1. on the server of Essbase, put in place a system odbc for your MySQL database connection
  2. in the State of charge, go to the file menu and select open source SQL database and in the source of data in your SQL statement. A few tips. Where it says select, don't put in the select Word and when he says to not put in of. The system adds for you. TI enter a simple SQL statement is to do this in the box so select if your SQL would be normanlly as select * from myTable just enter the code as * from myTable in the upscale neighborhood

  The ol/recover the click and fill your connection information. Should bring back the data in the State of charge. Save the State of charge and use

• Loading data from DB.

  Hello!
  I have the database with 5 tables empty and cca 420 csv files.
  
  TABLES looks like
  Table1 (vtime, id1, id2, id3 70..)
  Table2 (vtime, 71, id72, id73... id140)
  VTIME value is in each table from 1 to 22 368 145
  
  CSV resembles
  CSV1 (vtime, id, x, value) [vtime is for example 1 to 53250]
  CSV420 (id, x, vtime, value) [vtime is for example 22 314 895 to 22 368 145]
  There are all the IDS of each CSV file
  
  
  What is the fastest way and to load data from csv to table?
  I wanted to use sql loader, but I can't specify something like -
  + load data from csv files 420 all and value at position 2 is (1-70) [71-140] {...}, load his value (position 3) (table 1) [table 2] {...}, rowing where vtime in the table is the same as for value(position 1) vtime + *.
  
  Can you help me with this please? Thank you!

  What is the fastest way and to load data from csv to table?

  Use an external table.
  In this way, you can do Oracle treat your files as if they were tables.
  You will have many more opportunities in this way.

  http://asktom.Oracle.com/pls/Apex/f?p=100:11:0:P11_QUESTION_ID:6611962171229
  http://www.Oracle-base.com/articles/9i/SQLNewFeatures9i.php#ExternalTables
  http://asktom.Oracle.com/pls/Apex/f?p=100:11:0:P11_QUESTION_ID:2754967100346565998

• Loading data from Microsoft Dynamics AX via FDM

  Hello world

  I was wondering if anyone was using FDM to load data from Microsoft Dynamics AX into HFM via FDM, and how this was done. We are currently on version 11.1.2.2.0, thanks for any idea.

  The easiest way would be to get the MS Dynamics team to provide a flat file extracts the required data and then use FDM to import in HFM. There is not out of the box adapters to interface directly with MS Dynamics, but another option would be to build an integration script to interface directly with the data in the relevant MS Dynamics via FDM tables but it would be more involved and require a knowledge of the underlying database MS Dynamics, FDM scripting, dry and would be much more difficult to maintain for the average user.

• Loading data from the planning application sample

  Hello
  
  I created an example of planning application in the workspace (V 11.1.1.3). By default, they dimension 'Year' the year of departure as FY11. Whereas, loading data from file 'SampleApp_data.txt' that comes with the installation is the year of departure as FY09. Then, when I insert data in environmental assessment (form free loading), there is an error that the FY09 member is not present. Does anyone know how can I approach properly load the sample data? I tried to replace by FY11 by FY12 FY10 FY09 and so forth in Notepad, but the process still hang on the first attempt.
  
  Thanks in advance,
  Aerts

  The easiest way is not sample application tick the options and change the calendar 2008 or 2009, go to the finsh tab, then return to the first screen and sample application tick, then finished, it will create with the year of departure.

  See you soon

  John
  http://John-Goodwin.blogspot.com/

• How to load data from workflow

  How to load data from workflow (POAPPRV.wft, QAPPRV.wft)
  
  11i apps

  Hello

  Use WFLOAD to load the workflow data I.

  WFLOAD apps / 0 Y FORCE xxxx.wft
  WFLOAD apps / 0 Y FORCE xxxx.wft

• Lock on a table and SQL * Net more data from client

  Hello

  I have a problem loading data through Php in Oracle: web page of Php open an xml file, create a .csv, then begins to Oracle using an external table to process the data.

  The problem is that, the second time that PHP is trying to run the following query:

  INSERT INTO table1 T (Field1, Field2, field3, field4, sphere5, case field6) VALUES ('Aaa1E63819707', SYSDATE, 'KO', 'error', 'L', 'file_name.xml') POLL INTO Field1: id

  on the Oracle sessions, I have an exclusive lock on table1 and wait for SQL * Net more data from client.

  Where is the problem?

  Thank you

  Igor

  Finally I found the problem: a DBA changed the cursor sharing EXACT force! I restored the CORRECT setting and now everything is fine.

  Thank you

  Bye,.

  Igor

• SQL * Net more data from client wait event

  Hi all

  DB 11.2.0.2

  AIX 6

  I get two events of high expectation of the AWR report page

  (1) SQL * Net more data from client

  synchronization of log files 2)

  Need advice to the configuration of the hardware and network latency?

  What should I do for the first event of waiting?

  This simple average may, what they're doing massive data loads with a very large table size that the Oracle Server manages very effectively but necessarily expect much coming data of the customer and parallel large log files written to end on the validation.  It is possible that setting a large SDU and tcp large transmiat and receive buffers would help if this happens to be what they do; Similarly, if that's what they do, then reduce their size of table can also have some effect.

  Concerning

  Jonathan Lewis

• How transform the trailing spaces &amp; AREAS of data from sybase to oracle

  Helllo,

  We are the migration of data from sybase to Oracle using goldengate... Source Sybase with SPACES (single / Multiple) as data to CHAR/VARCHAR that will be migrated to the VARCHAR2 data type in Oracle. I'm having trouble trying to implement under two conditions to transform the data

  1) Remove SPACES during the IPL for CHAR/VARCHAR

  example: Data Source: "TRAILING SPACE.

  Given target expected - remove the spaces of trailinging: "TRAILING SPACE.

  2) If the data with SPACES like a value (single or Multiple) will be loaded as a single SPACE in Oracle.

  example : Source data                                                  :  "          "

  Expected data from target - unique space:

  Map: dbo. Target TEST_TABLE DEV01. Table_test, COLMAP (USEDEFAULTS, CRE_ID = @IF (@STRRTRIM (CRE_ID) = @NULL AND CRE_ID <>@NULL, ' ', @STRRTRIM (CRE_ID)));

  I tried above mapping in the settings file, but it returns error like below, guidance on the highest implementation requirement will be useful.

  ... RIM (CRE_ID) = @NULL AND CRE_ID...

  ^

  Error in the COLMAP clause. Invalid function or argument.

  Under column mapping is worked :-)

  Map: dbo. Target TEST_TABLE DEV01. TABLE_TEST, COLMAP (USEDEFAULTS, CRE_ID = @IF (@STRLEN (@STRTRIM (CRE_ID)) = 0, ' ', @STRRTRIM (CRE_ID)));

• Script Insert statement to extract data from Table in Oracle 7i

  Hi all, I have an old Oracle legacy system that works for more than 15 years. Every now and then, we need to extract data from this table @ ORacle 7i to import to Oracle 10 G.
  
  My thoughts are to create a script to Insert statements in oracle 7 and that, to be deployed to Oracle 10 G.
  
  I found cela scripts in Google and don't know exactly how it works. No explanation on these scripts, would be greatly appreciated. I find that this format can help to produce a set of insert statements in this table to the last table to 10G.
  
  < pre >
  -Step 1: create this procedure:
  create or replace function ExtractData (v_table_name varchar2) return varchar2 as
  Boolean b_found: = false;
  v_tempa varchar2 (8000);
  v_tempb varchar2 (8000);
  v_tempc VARCHAR2 (255);
  Start
  for tab_rec in (select table_name from user_tables where table_name = upper (v_table_name))
  loop
  b_found: = true;
  v_tempa: =' select ' insert into ' | tab_rec.table_name |' (';
  for col_rec in (select * from user_tab_columns)
  where
  table_name = tab_rec.table_name
  order by
  column_id)
  loop
  If col_rec.column_id = 1 then
  v_tempa: = v_tempa | " ' || Chr (10) | " ' ;
  on the other
  v_tempa: = v_tempa |', ". Chr (10) | " ' ;
  v_tempb: = v_tempb |', ". Chr (10) | " ' ;
  end if;
  v_tempa: = v_tempa | col_rec.column_name;
  If instr(col_rec.data_type,'CHAR') > 0 then
  v_tempc: = "' |' | col_rec.column_name |'| " ' ;
  elsif instr (col_rec.data_type, 'DATE') > 0 then
  v_tempc: = "' to_date ("'| to_char('|| col_rec.column_name||',''mm/DD/YYYY HH24 '') | ") (', "' dd/mm/yyyy hh24"') "';
  on the other
  v_tempc: = col_rec.column_name;
  end if;
  v_tempb: = v_tempb | " ' || Decode('|| col_rec.column_name||',''Null'','||v_tempc||') | " ' ;
  end loop;
  v_tempa: = v_tempa |') values ('| v_tempb |'); "from ' |" tab_rec.table_name | « ; » ;
  end loop;
  If not b_found then
  v_tempa: ='-Table ' | v_table_name | 'not found ';
  on the other
  v_tempa: = v_tempa | Chr (10) | "select"-commit; "double;';
  end if;
  Return v_tempa;
  end;
  /
  display errors
  
  -STEP 2: run the following code to extract the data.
  Go head
  set pages 0
  game of stripes on
  fixed lines 2000
  the feeding off value
  trigger the echo
  var retline varchar2 (4000)
  coil c:\t1.sql
  Select 'set echo off' from dual;
  Select 'spool c:\recreatedata.sql' from dual;
  Select ' select "-these data was extracted on" | TO_CHAR (sysdate, "mm/dd/yyyy hh24" ") double;' double.
  
  -The following two lines as repeat as many times as the tables that you want to extract
  exec: retline: = ExtractData ('dept');
  print: retline;
  
  exec: retline: = ExtractData ('emp');
  print: retline;
  
  Select 'off spool' from dual;
  spool off
  @c:\t1
  
  -Step 3: run the updated c:\recreatedata.sql waiting for output to recreate the data.
  
  Source: http://www.idevelopment.info/data/Oracle/DBA_tips/PL_SQL/PLSQL_5.shtml
  
  
  
  
  < / pre >

  Hello

  Well what this script do.
  You will pass a table name as input to the function that will return varchar2 (string - insert statement). It will generate 2 t1.sql of sql script that contains the output sequence.

  Will use the first passed the user_tables scipt to check if the input table name exists and if there is the will reterive user_table_columns column names and generate the following sql script.
  Now, this t1.sql will run to generate a final sript formally orders insert that will run you on the target schema (make sure that the table exists).

  * #t1.sql*

  set echo off
  spool recreatedata.sql
  select '-- This data was extracted on '||to_char(sysdate,'mm/dd/yyyy hh24:mi') from dual;
  select 'insert into MY_OBJECT1 ('||chr(10)||'OWNER,'||chr(10)||'TOTAL) values ('||decode(OWNER,Null,'Null',''''||OWNER||'''')||','||chr(10)||''||decode(TOTAL,Null,'Null',TOTAL)||');' from MY_OBJECT1;
  select '-- commit;' from dual;
  spool off
  

  Then @t1.sql runs, and the general insert for the infeed table table.

  -- This data was extracted on 03/09/2009 23:39
  
  INSERT INTO MY_OBJECT1 (OWNER, TOTAL)
    VALUES   ('MDSYS', 92800);
  
  INSERT INTO MY_OBJECT1 (OWNER, TOTAL)
    VALUES   ('TSMSYS', 256);
  
  INSERT INTO MY_OBJECT1 (OWNER, TOTAL)
    VALUES   ('DMSYS', 15104);
  
  INSERT INTO MY_OBJECT1 (OWNER, TOTAL)
    VALUES   ('TESTME', 128);
  
  INSERT INTO MY_OBJECT1 (OWNER, TOTAL)
    VALUES   ('PUBLIC', 2571392);
  
  INSERT INTO MY_OBJECT1 (OWNER, TOTAL)
    VALUES   ('OUTLN', 768);
  
  INSERT INTO MY_OBJECT1 (OWNER, TOTAL)
    VALUES   ('CTXSYS', 21888);
  
  INSERT INTO MY_OBJECT1 (OWNER, TOTAL)
    VALUES   ('OLAPSYS', 78336);
  
  INSERT INTO MY_OBJECT1 (OWNER, TOTAL)
    VALUES   ('KLONDIKE', 2432);
  
  INSERT INTO MY_OBJECT1 (OWNER, TOTAL)
    VALUES   ('SYSTEM', 51328);
  
  INSERT INTO MY_OBJECT1 (OWNER, TOTAL)
    VALUES   ('EXFSYS', 21504);
  
  INSERT INTO MY_OBJECT1 (OWNER, TOTAL)
    VALUES   ('DBSNMP', 4096);
  
  INSERT INTO MY_OBJECT1 (OWNER, TOTAL)
    VALUES   ('ORDSYS', 216192);
  
  INSERT INTO MY_OBJECT1 (OWNER, TOTAL)
    VALUES   ('SYSMAN', 111744);
  
  -- commit;
  

  Hope this helps
  Concerning

• Loading data from Oracle to MS SQL SERVER

  Hello
  
  Source: Oracle
  Target: MS SQL
  ODI:11 g
  
  
  I want to create an interface that loads the data from the source table in Oracle in the target table in MS SQL Server. Can any body tell me what LKM, IKM and CKM I use for the same.
  
  Any help will be appreciated.
  
  I thank you,
  Shrinivas

  Hi gisele, you can follow below KMs

  1 LKM SQL for SQL

  2 CKM ORACLE

  3 IKM SQL Incremntal update (Insert and update) / IKM SQL command APpend (insert only)

  It will be useful.

  Thank you

• Cannot find the file error when loading data from text file to Oracle

  Hello
  
  I have an interface where I am loading a data from the text file to Oracle.
  But when I try to do that I am getting following error.
  
  ODI-1227: SrcSet0 (load) task fails on the source FILES SAPMM connections.
  Caused by: java.sql.SQLException: file not found: d:/mdb/#General.get_filename
  to com.sunopsis.jdbc.driver.file.FileResultSet. < init > (FileResultSet.java:160)
  at com.sunopsis.jdbc.driver.file.impl.commands.CommandSelect.execute(CommandSelect.java:57)
  at com.sunopsis.jdbc.driver.file.CommandExecutor.executeCommand(CommandExecutor.java:33)
  
  SAPMM is the name of the connection.
  I use get_filename to get the name of the file and it is fetching a correct value as long as this variable is updated in the previous stage of this interface.
  KM, used for loading is SQL file
  
  What would be the cause of this error?
  
  Thank you
  Mahesh

  Also a single query would be ok if I'm moving only generated package (according to your scenario3) scenario and not UI? It running properly?

  Yes... It runs successfully