To jump with LKM file to Oracle (SQLLDR) rest area
Hello worldI was wondering if there is a way to jump from the staging area during the loading of a flat file using SQLLDR KM? I need to load 1500 + daily files as soon as possible in a table and then process the data.
ODI is now loading in staged using the LKM at Oracle (SQLLDR) file then table final staging using IKM SQL command append...
Nick
If you have access to Metalink:
https://support.Oracle.com/CSP/main/article?cmd=show&type=not&ID=762723.1
Tags: Business Intelligence
Similar Questions
-
Failure of the LKM FILE to Oracle (SQLLDR)
HI -.
I'm trying to load a file into an Oracle using the LKM FILE to Oracle (SQLLDR) table. I don't have any changes to the default values in the LKM. But the process fails to call sqlldr ss_o step.
This is the message of control file
OPTIONS)
SKIP = 1,
ERRORS = 0,
DIRECT = FALSE
)
DOWNLOAD THE DATA
INFILE 'D:\ODI_META\METAFILES/test.txt' ' X "0D0A" str
BADFILE "D:\ODI_META\METAFILES/test_name.bad."
DISCARDFILE 'D:\ODI_META\METAFILES/test_name.dsc '.
DISCARDMAX 1
IN THE ODI_STAGING TABLE. "" C$ _0test_name ".
FIELDS TERMINATED BY X 7 IT
TRAILING NULLCOLS
(
C1_PERIODDATE,
C2_LES
)
File error message "SQL * Loader-101: invalid argument for the name of user and password.
Someone knows what's the problem?
-appHello
Read the requirement of KM... it will be mentioned that you need a customer installed Oracle Tnsnames.ora file must be configured, source file must be accessible to all mapping needs to run on the staging agent ODI etc.
Check each requirement of the KM and to implement the same.
Thank you
Fati -
Have 'LKM file to Oracle (SQLLDR)' use the existing staging tables
Our application has already has its set of staging tables. Is there a way to customize the file LKM to Oracle (SQLLDR) to use those rather than creating new ones on the fly?
Published by: cmb629235 on November 17, 2010 18:40Ok
If you need more help let me know...
http://odiexperts.com
-
Error; LKM file to orcale (sqlldr)
Hi all
I have a flat file with millions of data and for best performance use LKM in Oracle (SQLLDR) file. "When loading data from flat file to oracle, I don't mistake on step no IE 4.
Call sqlldr via Jython. "The ODI version is 10.1.3.4.6.
On the CTL directory the file is created and the FILE was also formed. In the txt file, I get the following message
"
SQL * Loader: Release 10.2.0.1.0 - Production on Mon Aug 10 10:49:35 2009
Copyright (c) 1982, 2005, Oracle. All rights reserved.
SQL * Loader-101: invalid argument for the name of user and password
"
For debugging in the operator the JYTHON transformed language is
"import bones."
If os.system (r ' sqlldr log=C:/SNAPON/US_CATALOG.txt.log userid = SNAPON_W control=C:/SNAPON/US_CATALOG.txt.ctl / < @= snpRef.getInfo ("DEST_PASS") @ > @ > C:/SNAPON/US_CATALOG.txt.out "" ") <>0:
lift the 'OS command reported errors.
and the ERROR I received is
"org.apache.bsf.BSFException: exception of Jython:
Traceback (innermost last):
"< String >" file, line 3, in there?
Order of the OS reported errors
at org.apache.bsf.engines.jython.JythonEngine.exec(JythonEngine.java:146)
at com.sunopsis.dwg.codeinterpretor.k.a (unknown Source)
at com.sunopsis.dwg.dbobj.SnpSessTaskSql.scripting (unknown Source)
at com.sunopsis.dwg.dbobj.SnpSessTaskSql.execScriptingOrders (unknown Source)
"
When I tried to load data from flat to oracle external with the help of the CTL file created, it was loaded successfully theough CMD prompt.
Please help me as soon as POSSIBLE.
Thank you
NeerajHello
The leak ' @' after that the substitution of <@=snpRef.getInfo("DEST_PASS")@>method causes the error.
The solution was simply to fill in the Instance / dblink (database server) on the ground with the SID of the Oracle
Thank you
@=snpRef.getInfo("DEST_PASS")@>
Fati -
ODI 12 - problem with LKM SQL for Oracle
Hi again,
Three days ago, that I asked about the problem with the data types of data warehouses in models that were missing. After you apply the ideas suggested by Rita (thank you very much ) I got from their work.
But after that, we came across a new problem. When you run a mapping (Oracle for Oracle databases), it failed on the second stage - ' "work table create. "When we checked the generated code was something like this: '(" CREATE TABLE < work_table_name >). None of the names of columns or data types have been described in parentheses and as expected, the ODI execution error was "invalid identifier". It seems that API
odiRef.getColList(params)%>
does not work. I tried loading using LKM Oracle Oracle (DB LINK) but once again the columns are missing in the generated script.I have to mention the master and work repositories are different databases from Oracle and ODI Agent is not installed because of some problems.
We are still beginners of ODI and would appreciate any help from more experienced guy (or other beginners).
Thank you in advance.
Just by chance, we found the soluton today!
The reason of missing generated code was that the description of the types of data was not entirely cofigured.
We found that the fields "create table syntax" and "'syntax of data accessible in writing' in each type of data in the topology definition were empty." After filling them, the generation of the script is running properly.
Before that we had problems with missing data types in models and we realized the reverse engineering of the types of data, but obviously it is insufficient.
Thanks to all those who participated in the discussion and tried to help us!
-
Hello team, I get this error at the start of my database.
System Global area 1.8254E + 10 bytes
Bytes of size 2116304 fixed
2248148272 variable size bytes
1.5989E + 10 bytes database buffers
Redo buffers 14659584 bytes
ORA-00214: control file ' / app/oracle/data2 / < sid > / control02.ctl' version
"15166739 incompatible with the file ' / app/oracle/data1 / < sid > / control01.ctl".
version 15166687
Can someone help me solve this problem.
Thank youcool, congratulations! OK, now mark the question as answered to close this thread!
-
When I click on a shortcut on my desktop I get a message saying that the file does not have a program assoiated with this file
Hello
These are shortcuts to Internet?
1. make sure that Internet Explorer is the default browser to the control panel > Add/Remove Programs > Set Program Access and Defaults, choose Microsoft Windows or custom. Make sure that IE is selected as the default browser.
2. on this page download and run the patch for files of the URL.
Difficulties of Windows XP file association:
http://www.dougknox.com/XP/file_assoc.htmDon
-
I have an old Outlook on a computer file before I want to be able to read about this new computer Win7.
I could be wrong and certainly can be corrected, but...
United are a few highlights of what is contained on the Exchange server where this account has been set up.
Maybe it was a corporate email account that you have taken with you when you left or found in an old backup?
If so, there are legalities involved and I would not advise to play with the file.If they are legitimate emails, free and clear - so maybe the account is still active and you can set up the account and re-download the messages.
Otherwise, there are several (very expensive) programs that will convert him, about $600 if my memory is.Sorry, probably NOT the answer you were hoping for.
VP Tech Services
-
problem in the control file created by file LKM to Oracle (SQLLDR)
I have a fixed file ABC.txt and it has three fields/columns of length, C1: = 4, C2: = 10 & C3: = 6 & I use LKM to Oracle (SQLLDR) file to load data into the target oracle table.
I received the following error message in step CALL SQLLDR at km
"org.apache.bsf.BSFException: exception of Jython: Traceback (innermost last):
File "< string >", line 3, in? »
Then I checked the registry of file control and found that the start value position & final value was not defined in the control file that is created automatically by LKM
"
SQL * Loader-350: error of syntax on line 14.
Expects an integer positive, found ': '.
C1_C1 POSITION (:) '
The control created by ODI file & the position value is missing.
OPTIONS)
SKIP = 0,
ERRORS = 0,
DIRECT = FALSE
)
DOWNLOAD THE DATA
INFILE 'C:/SNAPON/EOL.txt '.
BADFILE "C:/SNAPON/ABC.bad."
DISCARDFILE 'C:/SNAPON/ABC.dsc '.
DISCARDMAX 1
IN THE TABLE SNAPON_W.C$ _0ABC
(
C1_C1 POSITION (:),
C2_C2 POSITION (:),
C3_C3 POSITION (:)
)
'
Anyone know why the position value is not created in the control file.
Published by: neeraj_singh on March 3, 2011 01:25Hi Neeraj,
It happens because you have not selected the area of mapping as STAGUING running.
Open your interface, click each column of your data target store, make sure that "run them One" is marked on the "transit Zone".
Then run your interface.
Thank you
Fati -
I use offline files in Windows 7 on a corporate network. Usually, it works very well, but sometimes, when someone else uses a file I get the message in sync results "Synchronization failed with offline files" and the files in question are wrong with the message "the process cannot access the file because it is being used by another process". I want to know is was it interrupted the entire synchronization process or if it is complete and just jump the files in question?
Hello
That your computer is under domain, you must contact the technet forum, where we have of the support technicians who are well equipped with the knowledge on the issues of domain, do visit the link provided below.
http://social.technet.Microsoft.com/forums/en-us/winserverfiles/threads
Thanks and greetings
-
Question to load the XML file into Oracle via ODI: LKM and IKM adjustment
Hi all
I am currently building an ODI interface to upload my file system XML local in a 10 g to Oracle database.
I received the error message shown in the screenshot below:
! http://img529.imageshack.us/img529/3491/odiscr175.jpg!
The main problem I have is, I don't know all what LKM or IKM assign.
Can someone offer any assistance/advice?
Thanks in advance.
JamesJames
You must select the LKM SQL for Oracle (or LKM SQL for SQL) and then within Oracle to integrate Oracle the IKM incremental update or append IKM SQL command.
Reading XML, you can just use the standard SQL KMs. (when writing, there's a little more necessary artifice, and this can be done by using specific IKMs)
Hope this helps -
MySQL to Oracle using LKM SQL to Oracle, poor performance
Hello
I'm on the underside of technology.
I'm try to use ODI to import data from MySQL to Oracle using the LKM SQL to Oracle, it works well for small amounts of documents but once volumes go higher it performs very badly.
I'm replacing an integration of existing HS dblink to 44 seconds and ODI is 9 minutes.
The MySQL and Oracle DB are on the same host with an autonomous ODI agent on the same host.
MySQL 5.6.21
Oracle 11.2.0.4
Oracle Data Integrator 12.1.3
I may try a different approach to dumping the MySQL table to a flat file and import from external table or sqlldr but y at - it a way to make the LKM SQL for Oracle perform better?
Hello
This problem has been resolved.
I was setting the table sizes in batches on the data source server, after you set the values on the target data server is it now works as expected.
Using a value of 5,000 for the two tables has reduced the operating time of 9 minutes to about 40 seconds.
-
While performing a mapping (present in the package) that loads the file to table data, my mapping is being failed in the step - LKM file with above mentioned SQL error.
This task is running for 30 candy Mint and loading data about 30 to 40 million for the temporary table of C$ ODI.
Before the completion of the task is to make failure and also C$ table is also get deleted.
Any possible resolution for above mentioned the issue?
Problems have been solved.
In our case, the prefix of all the data store name has been SRC_ so the nickname of all the data store became SRC, and the table name C$ depends on the daatastore Alias.
So for executing two mapping tables $ CAN have been getting dropped by other mapping due to the same table name $ CAN.
Change the Alias name giving it a unique name solve the problem.
-
RMAN backup on the database with data file with corrupted block
Hi friends,
I have a problem with a database of oracle 11g XE on windows server 2003, the database is in production, it is open, is operating normally.
The database has no backup configured before, so I put the database archiving mode and tried to backup using rman utility, but it show me some errors.
First of all, it showed me:
ORA-19501: error in reading file... SYSAUX. DBF
ORA-27070: async read/write failed
OSD-04016: error queuing an asynchronous i/o request.
And when I passed the dbv on the SYSAUX file utility. DBF showed the fatal error.
So, I switched CHKDSK utility on windows to repair the disc of the error. After that, run utility dbv and he passed and showed me the corrupt on SYSAUX blocks. DBF
Then, came to rman and ran:
RMAN > validate the logical database checking;
State of the file marked corrupt blocks examined empty blocks high YVERT
---- ------ -------------- ------------ --------------- ----------
3 0 1111 115840 78859075 FAILED
File name: C:\ORACLEXE\APP\ORACLE\ORADATA\XE\SYSAUX. DBF
Type block for lack of treated blocks blocks
---------- -------------- ----------------
Data 0 0
Index 0 0
Other 38 114729
After that: watching the content of v$ database_block_corruption;
Show me a lot of lines like this:
SQL > select * from v$ database_block_corruption;
FOLDER # BLOCK # BLOCKS CORRUPTION_CHANGE # CORRUPTIO
---------- ---------- ---------- ------------------ ---------
3 4440 1 FRACTURED 0
3 4439 1 0 ZERO ALL THE
3 4386 2 FRACTURED 0
3 4384 1 0 ZERO ALL THE
3 4334 1 0 ZERO ALL THE
...
33 selected lines.
Finally I try to rerun rman and he shows me the error:
ORA-19566: exceeded the limit of 0 blocks corrupt file C:\ORACLEXE\APP\ORACLE\ORADATA\XE\SYSAUX. DBF
How can I do backup with rman? Maybe I can by pass the corrupt block?
I'll be grateful for any help you can provide.
=)
It would be better if you try to find the reason of corruption and try to recover the corrupt blocks. A block corrupted in the backup would really not must use. But if you're ready to take backup, you can ask RMAN to ignore corrupt blocks and move forward.
Use the pseudo-code for the backup
Run {set maxcorrupte for the database
to 10; backup tablespace sysaux ;}
HTH
Aman...
-
How to create a Shell (.sh) file in Oracle using PL/SQL?
Hello world
I would like to know how to create a .sh file or any .txt file in Oracle. I would like to get the contents of the file from a table that has different settings. I used bcp in SQL Server and wonder if it's possible in Oracle to create this file.
Here are the DDL and DML in the table:
Maybe you are looking for
-
Had to reinstall Windows on a Mini 1001TU (NE570PA #ABG). A search in the support pages refuses to acknowledge even the product number. I 'discovered' drivers in the wild, but don't make them not trust. Where to find the drivers for this machine on a
-
Trigger start CTR - USB6343 error
Hi- A digital pulse of a device in my system is connected to the door of CTR0 (PFI9). CTR0 is used as a quadrature encoder. My code road PFI9 to the door of the CTR1 (PFI4) and also defines PFI9 as a trigger to start for CTR3. CTR3 is set to generate
-
SkyDrive links added to all default email on the last document
Attaching a series of 4 documents to an email in Hotmail via skydrive translates into hyperlinks for each document appearing as a list in the email as well as hyperlinks allowing you to ' go to ' 4 documents or download as a zip file. Using the two l
-
See the question above. To add to my H, Helper, it will not install two of my drivers. Everything is installed correctly. I bought the ICA. Key figures. Also, does anyone have a phone number for support center that could help me too? Thank you Earl E
-
Using Windows Media Player 12 (w/under Windows 7), "can I ripping the same song, several times, using different bitrates & and/or formats and store all the digital music files in the music library by default WMP - 12, on the same hard drive? 1.) #1 g