Importing bulk data into Oracle - with restrictions

Hello

I am trying to insert data from a stream (inside the ETL tool) of bulk in Oracle via a stored procedure, but under many restrictions. Hope you can help.

Oracle 10 g database is.

There is up to 1 000 000 records of about 100 bytes each, through delivery, to about 200 000 000 per day.

Target table:

CREATE TABLE TBL_STG
("KEY", NUMBER (13.0),)
"ATT_1" NUMBER (1.0).
NUMBER (14.0) "TIMESTAMP."
"ATT_2" NUMBER (14.0).
"ATT_3" NUMBER (14.0).
"ATT_4" NUMBER (2.0).
"ATT_5" NUMBER (1.0)
)

I can easily convert the stream of input documents in a collection (list separated by commas, for example) with the ETL tool that I use. I then call the stored procedure with the collection of records (delimiter: comma) as one of the parameters.

The problem is that I am using the ETL tool in slightly modified middle (emulation of continuous treatment) which greatly limits my possibilities to load data into Oracle.

Basically, I can't use utilities (for example, SQL * Loader), except when writing to disk first! Neither the tool provided support for the api.

I'm now calling a stored procedure with a collection set however it gives the problem types are NOT taken in charge the following data:

Nested table, VARRAY/ANYTYPE: gives an error of type 108 unknown column
index - by table (old style): unknown col.tp. 152
Clob/NCLOB: unkn.col.tp 112
BLOB: 113

All I have left is the stored procedure:

LONG BELIEVED, GROSS, LONG.

These data types are not recommended, but at least still supported by 10g.

So where did that my question, in these circumstances, could you provide me with assistance towards passing the RAW collection /... and interpreting it as a digital table in Oracle. Your help is greatly appreciated.

Thank you

(deleted - double post)

Edited by: nthomas on January 6, 2009 14:43

Tags: Database

Similar Questions

  • Import text data into text with script level file fields


    I use Adobe 9 professional and have a level of javascript file import text into the existing fields of a pdf document.

    There are several fields with multiple lines of data to import.

    The folder level script does not work (but there is no error in the console showing when operating)

    I manually tested the file opening text with the following code in the console and the text file opens and fills text fields, so the text file must be correct:

    this.importTextData ();

    The following code is the folder level script that does not work:

    function mailmergeFunction()

    {


    Import the first line of data of "Mailmerge.txt".

    this.importTextData ("of/h/mailing/Jo Smith Things / Mailmerge.txt", 0)


    If (typeof cnt == 'undefined') cnt = 0;
    this.importTextData ("of/h/mailing/Jo Smith Things / Mailmerge.txt", cnt ++ % 4)

    }


    app.trustedFunction (mailmergeFunction);

    app.addToolButton ({cName: "Mailing", cExec: "mailmergeFunction ()", cTooltext: "Mailing", cEnable: true, NPO: 14});

    If anyone can please provide assistance, it will be more appreciated thanks.

    Try using an app.beginPriv () just before the importTextData statement and a statement of app.endPriv () afterwards. Don't forget to restart Acrobat after you change the JavaScript file.

  • Import excel data in oracle tables

    Hello gurus,
    Importing excel data in oracle tables...

    I know it's the most common question on the wire... First, I searched the forum, I found lots of threads with loading data using sqlloader, excellent in conversion. Txt, file delimited by tabs, file .csv etc...

    Finally, I was totally confused in terms of how to get there...

    Here's wat I
       - Excel file on local computer.
       - i have laod data into dev environment tables(So no risk involved, but want to try something simple)
       - Oracle version 11.1.0.7
       - Sqlplus and toad (editors)
       
     
    Here's wat I want to do... .i don't know if its possible
        - Without going to unix server can i do everthing on local system by making use of oracle db and sqlplus or toad
       
    SQLLOADER could be an option... but I don't want to go the unix server to place files and newspapers and stuff.

    Wat will be the best option and the easiest to do? and wat format better convert excel csv or txt or tab delimited etc...


    If you suggest sqlloader, any example of code will be greatly appreciated.


    Thank you very much!!!

    Hello

    Toad version 9.0.0.160, you can directly load data excel file (or any other specified) to table using the navigation "database > import > import the data in the table.
    You need to connect to the database, then go to the above navigation. Select the table, validation interval (i.e. commit after each record or once all records), map columns in excel file to your table and press ok.
    It loads data directly to your table.

    But, if you use characters multibyte (such as Chinese) in excel file you want to load, then you must make some settings in your machine.

    Don't know if its possible in another version of Toad.

    Concerning
    Imran

  • Import Excel file into oracle Apex table

    Hello

    using the Application Express 4.2.5.00.08

    Oracle 11g.

    My question is how do I import data into oracle using the APEX of EXCEL file table please? Any other file format.

    Thank you very much

    RI

    Irha10 wrote:

    using the Application Express 4.2.5.00.08

    Oracle 11g.

    My question is how do I import data into oracle using the APEX of EXCEL file table please? Any other file format.

    Use plug-ins Excel2Collections.

  • Import Excel data into Form Designer

    I developed a dynamic form in Livecycle designer that will be sent to hundreds of schools throughout Nebraska.  There is a table in this form that has buttons to add or remove a line while dependent students informtion can be entered in this table. How I shape now works perfect for most schools, however; with the largest schools that will enter in over 200 different lines of information, it will be a long unessarily task.  Most of these schools already have the information that we solicit in an Excel file.  Is it possible for an end user of this form, using the adobe reader software to import excel data into the table?

    -Susann Wenzel

    It is possible, but you will find may be more difficult than what it's worth.

    1. you must manipulate the worksheet to make it look like a DB

    2. you must set up an ODBC connection on the system running the form and the worksheet...

    3. you would have to change to point to the worksheet from the definition

    4. you wish Reader the form using LiveCYcle Reader Extensions to allow the ODBC connection occurs in the drive.

    Paul

  • Importing data into Oracle Apex

    Hello

    I have an obligation to provide a screen to the user where they can import excel data to an existing table and I saw a feature in the workshop of data in Oracle Apex, but I can't use that since I have extra things added into that must. The requirment is mentioned below,

    (1) need a screen where the user can select the excel file and start the import of a temporary table without validation
    (2) the data from the temporary table must be visible to the format of form Multi line in the screen and the user must be able to modify the data
    (3) the need for a feature or a screen mapping where the user can map the temporary table to the original table column before you pass data to the original (as data) table
    (4) the data should be transferred in the original table and the respective data should be deleted from the temporary table (in case if an error occurs, error record must appear in a temporary table up to less than the user of the corrected data into the original table)
    (5) need to add different types of validation, update the record in the original record if same id is available or insert a record value, non-zero, etc...

    Please suggest me how can I do this in the Apex.

    Is it possible to use the existing data and design workshop robot code in my new screen?

    You will probably have to code this yourself... There are packages that have been written to import Excel and CSV style...

    Here's a blog entry to make the upload of Excel file: http://avdeo.com/2008/05/21/uploading-excel-sheet-using-oracle-application-express-apex/

    Once you call who you might have a tabular layout displays the data to the user...

    Other processes must be written by you (migration of data from the temporary table to the table of live data...

    Thank you

    Tony Miller
    Webster, TX

    On the road of life... He has "windshield", and there are "bugs".
    (splat!)
    "Squeegees wanted."

  • I can't import audio data into Flash pro Cs5

    I can't import audio data Flash Pro Cs5, I'm new to Flash pro and I'm working on an interactive story, I need audio that I download from incompetech.com. MP3s are fine and play in windows Mp3, but when I try to bring them into Flash I get a message saying that it can't import them and does not say why. I have looked at this but impossible to find an answer, I work with windows 7, flash Cs5 64 bits in actionscript 2.0 and I do not have a good editior just flash.

    -Thank you

    This usually means that there is a problem of sampling rate.

    Load your mp3 into a sound editor and then export it using the standard settings.

  • Merge data into InDesign with Hebrew characters

    InDesign CC 2014 on Windows 7 Ultimate

    I had an Excel file which contains mainly in English, but has a few words of Hebrews here and there. I was unable to save as a CSV file retaining the Hebrew from Excel, so I downloaded Google leaves and downloaded in CSV.

    When I open the CSV file in Notepad, it looks perfect with Hebrew, although if open in Excel the characters are distorted.

    When it is used to merge data into InDesign, the Hebrew characters appear as such mutilated versions only displayed in Excel.

    I use GREP to format the Hebrew characters.

    I have a feeling that the problem is at the "save CSV" step, but I do not know how to remedy this.

    Any help much appreciated.

    Thank you

    Ruth

    Instead of changing the file extension, try saving the text with UTF-8 encoding.

    Excel: Save as type > text (separator: tab) > Tools > Web Options > Encoding > Unicode UTF-8

  • Insert data into Oracle DB from MS Access Forms

    Dear professionals,
    How to insert data into the table that reside in the Oracle DB through MS Access forms?
    We have already created ODBC link tables Oracle allows you to select data, and it works.
    Unfortunately, we can select only the data, but insert, delete and update are not available via MS Access form, even if the user has all permissions on the oracle DB (grant select, insert, update, delete on oracle_table to access_user).


    driver: Microsoft ODBC for Oracle
    MS Access 2003
    Oracle DB 10.2

    THX in advance,
    Adnan

    One would need to know what means "not available". You get a specific error? As far as I know your statement is simply incorrect.
    There are perhaps incompatibilties between DLLs Microsoft and Oracle, I would avoid the Microsoft ODBC for Oracle driver like the plague!

    ---------
    Sybrand Bakker
    Senior Oracle DBA

  • Import Excel data into Dreamweaver

    Hello everyone, I'll try to be as descriptive as I can with what I want.

    In short: I would like to be able to have the date of importation of Dreamweaver (CS5) of cell A1 in the html code.

    More details: I have an ever-changing list of links that I would like the list to a Web site. And have auto update it in dreamweaver everytime I update the list in excel

    for example, I put in Dreamweaver < a href = "(insert)" > link 1 < /a >

    where see you (insert) I would like to be able to import the address of the link I have in cell a1 in my Excel spreadsheet.

    So overall I would like

    < a href = "(insertA1)" > link 1 < /a >

    < a href = "(insertA2)" > Link 2 < /a >

    < a href = "(insertA3)" > link 3 < /a >

    etc.

    How can I tell Dreamweaver to insert this single cell in the spot in html and then move on to the list of others the same way?

    I am a novice with html, css, so I use Dreamweaver for the first time to try to make this a little easier to follow.

    > Using a database that I would be able to choose certain sections of the list to be used by page

    Sure. Your table may contain a column that specifies what (category) page the link should appear on. Your request for this page would include a filter that returns only relevant links.

    > What would you suggest that I use to create data bases?

    You would use any DBMS provides your host. Most likely, this will be my MySQL.

  • Load data into Essbase with EAS (no space available on the device)

    Hello

    I exported all Essbase database data in a text file with EAS. The size of the file is 1.6 GB autour

    I want to load it into the same database on another server with EAS. And each time around 55%, EE gives me the error "No space" available on the device [ServerB]

    Here is the configuration:
    -Essbase server: 11.1.1.3 on a linux server has (enough space left for Essbase)
    -Server EAS: 11.1.1.3 on a linux server B (enough space for the data file)
    -EAS Client: 11.1.1.3 on my computer (Windows)
    -Data file: on my computer too

    Error messages tells me that there is no space left on the service Regional Server.

    Do you know where EE server temporarily load the data file before sending it to Essbase? So, I can increase my file system.

    Thanks for your help.

    Why don't you just copy the export more to the essbase server, personally I would not even try to send this amount of data over a network through the Regional service.

    See you soon

    John
    http://John-Goodwin.blogspot.com/

  • Import of the DMP Oracle with the unknown schema name

    Hello

    I need to import a DMP Oracle DBMS Oracle 11g by the SYSTEM. I don't know what patterns are stored inside.

    How can I get information, schemas are stored in the Oracle DMP?

    Thank you!
    Dejan

    You can check the conent of the bucket to help

    IMP usernmae/password file = log = show = Yes full = yes

    You can view the log file. It will import all the data, but gathers the information in logifle.

    Anil Malkai

  • Load table data into Oracle Essbase

    Hi all

    I have a problem

    1 oracle table have 50 million records

    Essbase load data from that

    ODI error message:

    Caused by: java.sql.BatchUpdateException: means: Java heap space

    at org.hsqldb.jdbc.JDBCPreparedStatement.executeBatch (unknown Source)

    at oracle.odi.runtime.agent.execution.sql.BatchSQLCommand.execute(BatchSQLCommand.java:44)

    at oracle.odi.runtime.agent.execution.sql.SQLExecutor.execute(SQLExecutor.java:102)

    at oracle.odi.runtime.agent.execution.sql.SQLExecutor.execute(SQLExecutor.java:1)

    at oracle.odi.runtime.agent.execution.DataMovementTaskExecutionHandler.handleTask(DataMovementTaskExecutionHandler.java:87)

    at com.sunopsis.dwg.dbobj.SnpSessTaskSql.processTask(SnpSessTaskSql.java:2913)

    at com.sunopsis.dwg.dbobj.SnpSessTaskSql.treatTask(SnpSessTaskSql.java:2625)

    at com.sunopsis.dwg.dbobj.SnpSessStep.treatAttachedTasks(SnpSessStep.java:577)

    at com.sunopsis.dwg.dbobj.SnpSessStep.treatSessStep(SnpSessStep.java:468)

    at com.sunopsis.dwg.dbobj.SnpSession.treatSession(SnpSession.java:2128)

    to oracle.odi.runtime.agent.processor.impl.StartSessRequestProcessor$ 2.doAction(StartSessRequestProcessor.java:366)

    at oracle.odi.core.persistence.dwgobject.DwgObjectTemplate.execute(DwgObjectTemplate.java:216)

    at oracle.odi.runtime.agent.processor.impl.StartSessRequestProcessor.doProcessStartSessTask(StartSessRequestProcessor.java:300)

    to oracle.odi.runtime.agent.processor.impl.StartSessRequestProcessor.access$ 0 (StartSessRequestProcessor.java:292)

    to oracle.odi.runtime.agent.processor.impl.StartSessRequestProcessor$ StartSessTask.doExecute (StartSessRequestProcessor.java:855)

    at oracle.odi.runtime.agent.processor.task.AgentTask.execute(AgentTask.java:126)

    to oracle.odi.runtime.agent.support.DefaultAgentTaskExecutor$ 2.run(DefaultAgentTaskExecutor.java:82)

    at java.lang.Thread.run(Thread.java:662)

    I think that Agent Load data so great, if memory cannot load.

    How to fix?

    Please give me a solution.

    Thank you

    As Craig said, move the staging area out the SUNOPSIS MEMORY ENGINE initially. This should only be considered if you are mobile / transform small amounts of data (including 50 million lines isn't :-)).) Why you do not set the staging on your Source Oracle DB in this way, you remove an unnecessary data movement i.e. the LKM and don't rely on memory in engine.

  • import schema data using oracle data pump

    Hi all

    I want to import a schema on a single server using IMPDP. But on this server, the user does not exists.is it is possible to import all the objects that break including the creation of the schema. In exp/imp, it may be possible. But in data pump I can't do the same. Its giving error that the user does not exist. For your reference, I'll give you the code below the import.

    Impdp system directory = DIR_DUMP logfile = expdp_tsadmin_tcgadmin_11182013_2_2.log

    dumpfile = expdp_tsadmin_tcgadmin_11182013_2.dmp PATTERNS = TS_ADMIN version = 10.1.0.2.0

    Pls help and thanks in advance.

    Thank you

    Piku

    Hello

    All errors are due to the fact that the tablespace that ts_data does not exist, everything else is hit because of this.

    create tablespace ts_data datafile 'xxxxxx' size xM;

    then try again

    See you soon,.

    Harry

  • Error when using SQL Developer to IMPORT access data in Oracle

    Hello
    I use SQL Develoepr to export the Access mdb file to Oracle. When I try to use the tools -? Migration-> Microsssfot-> export access
    I get an error message to attach the Access database file, the error indicates

    "Error #40179 - XMLExporter - Methiod 'AddFromFile' of object ' _References failed." Export failed.

    What could be the reason for this error please notify.

    Thank you

    Don't know if it is related to your question, but you need a JDK 1.6 (Java SDK). What do you get in Help - about - Version?

    K.

Maybe you are looking for