Importing bulk data into Oracle - with restrictions
HelloI am trying to insert data from a stream (inside the ETL tool) of bulk in Oracle via a stored procedure, but under many restrictions. Hope you can help.
Oracle 10 g database is.
There is up to 1 000 000 records of about 100 bytes each, through delivery, to about 200 000 000 per day.
Target table:
CREATE TABLE TBL_STG
("KEY", NUMBER (13.0),)
"ATT_1" NUMBER (1.0).
NUMBER (14.0) "TIMESTAMP."
"ATT_2" NUMBER (14.0).
"ATT_3" NUMBER (14.0).
"ATT_4" NUMBER (2.0).
"ATT_5" NUMBER (1.0)
)
I can easily convert the stream of input documents in a collection (list separated by commas, for example) with the ETL tool that I use. I then call the stored procedure with the collection of records (delimiter: comma) as one of the parameters.
The problem is that I am using the ETL tool in slightly modified middle (emulation of continuous treatment) which greatly limits my possibilities to load data into Oracle.
Basically, I can't use utilities (for example, SQL * Loader), except when writing to disk first! Neither the tool provided support for the api.
I'm now calling a stored procedure with a collection set however it gives the problem types are NOT taken in charge the following data:
Nested table, VARRAY/ANYTYPE: gives an error of type 108 unknown column
index - by table (old style): unknown col.tp. 152
Clob/NCLOB: unkn.col.tp 112
BLOB: 113
All I have left is the stored procedure:
LONG BELIEVED, GROSS, LONG.
These data types are not recommended, but at least still supported by 10g.
So where did that my question, in these circumstances, could you provide me with assistance towards passing the RAW collection /... and interpreting it as a digital table in Oracle. Your help is greatly appreciated.
Thank you
(deleted - double post)
Edited by: nthomas on January 6, 2009 14:43
Tags: Database
Similar Questions
-
Import text data into text with script level file fields
I use Adobe 9 professional and have a level of javascript file import text into the existing fields of a pdf document.There are several fields with multiple lines of data to import.
The folder level script does not work (but there is no error in the console showing when operating)
I manually tested the file opening text with the following code in the console and the text file opens and fills text fields, so the text file must be correct:
this.importTextData ();
The following code is the folder level script that does not work:
function mailmergeFunction()
{
Import the first line of data of "Mailmerge.txt".this.importTextData ("of/h/mailing/Jo Smith Things / Mailmerge.txt", 0)
If (typeof cnt == 'undefined') cnt = 0;
this.importTextData ("of/h/mailing/Jo Smith Things / Mailmerge.txt", cnt ++ % 4)}
app.trustedFunction (mailmergeFunction);app.addToolButton ({cName: "Mailing", cExec: "mailmergeFunction ()", cTooltext: "Mailing", cEnable: true, NPO: 14});
If anyone can please provide assistance, it will be more appreciated thanks.
Try using an app.beginPriv () just before the importTextData statement and a statement of app.endPriv () afterwards. Don't forget to restart Acrobat after you change the JavaScript file.
-
Import excel data in oracle tables
Hello gurus,
Importing excel data in oracle tables...
I know it's the most common question on the wire... First, I searched the forum, I found lots of threads with loading data using sqlloader, excellent in conversion. Txt, file delimited by tabs, file .csv etc...
Finally, I was totally confused in terms of how to get there...
Here's wat I
Here's wat I want to do... .i don't know if its possible- Excel file on local computer. - i have laod data into dev environment tables(So no risk involved, but want to try something simple) - Oracle version 11.1.0.7 - Sqlplus and toad (editors)
SQLLOADER could be an option... but I don't want to go the unix server to place files and newspapers and stuff.- Without going to unix server can i do everthing on local system by making use of oracle db and sqlplus or toad
Wat will be the best option and the easiest to do? and wat format better convert excel csv or txt or tab delimited etc...
If you suggest sqlloader, any example of code will be greatly appreciated.
Thank you very much!!!Hello
Toad version 9.0.0.160, you can directly load data excel file (or any other specified) to table using the navigation "database > import > import the data in the table.
You need to connect to the database, then go to the above navigation. Select the table, validation interval (i.e. commit after each record or once all records), map columns in excel file to your table and press ok.
It loads data directly to your table.But, if you use characters multibyte (such as Chinese) in excel file you want to load, then you must make some settings in your machine.
Don't know if its possible in another version of Toad.
Concerning
Imran -
Import Excel file into oracle Apex table
Hello
using the Application Express 4.2.5.00.08
Oracle 11g.
My question is how do I import data into oracle using the APEX of EXCEL file table please? Any other file format.
Thank you very much
RI
Irha10 wrote:
using the Application Express 4.2.5.00.08
Oracle 11g.
My question is how do I import data into oracle using the APEX of EXCEL file table please? Any other file format.
-
Import Excel data into Form Designer
I developed a dynamic form in Livecycle designer that will be sent to hundreds of schools throughout Nebraska. There is a table in this form that has buttons to add or remove a line while dependent students informtion can be entered in this table. How I shape now works perfect for most schools, however; with the largest schools that will enter in over 200 different lines of information, it will be a long unessarily task. Most of these schools already have the information that we solicit in an Excel file. Is it possible for an end user of this form, using the adobe reader software to import excel data into the table?
-Susann Wenzel
It is possible, but you will find may be more difficult than what it's worth.
1. you must manipulate the worksheet to make it look like a DB
2. you must set up an ODBC connection on the system running the form and the worksheet...
3. you would have to change to point to the worksheet from the definition
4. you wish Reader the form using LiveCYcle Reader Extensions to allow the ODBC connection occurs in the drive.
Paul
-
Importing data into Oracle Apex
Hello
I have an obligation to provide a screen to the user where they can import excel data to an existing table and I saw a feature in the workshop of data in Oracle Apex, but I can't use that since I have extra things added into that must. The requirment is mentioned below,
(1) need a screen where the user can select the excel file and start the import of a temporary table without validation
(2) the data from the temporary table must be visible to the format of form Multi line in the screen and the user must be able to modify the data
(3) the need for a feature or a screen mapping where the user can map the temporary table to the original table column before you pass data to the original (as data) table
(4) the data should be transferred in the original table and the respective data should be deleted from the temporary table (in case if an error occurs, error record must appear in a temporary table up to less than the user of the corrected data into the original table)
(5) need to add different types of validation, update the record in the original record if same id is available or insert a record value, non-zero, etc...
Please suggest me how can I do this in the Apex.
Is it possible to use the existing data and design workshop robot code in my new screen?You will probably have to code this yourself... There are packages that have been written to import Excel and CSV style...
Here's a blog entry to make the upload of Excel file: http://avdeo.com/2008/05/21/uploading-excel-sheet-using-oracle-application-express-apex/
Once you call who you might have a tabular layout displays the data to the user...
Other processes must be written by you (migration of data from the temporary table to the table of live data...
Thank you
Tony Miller
Webster, TXOn the road of life... He has "windshield", and there are "bugs".
(splat!)
"Squeegees wanted." -
I can't import audio data into Flash pro Cs5
I can't import audio data Flash Pro Cs5, I'm new to Flash pro and I'm working on an interactive story, I need audio that I download from incompetech.com. MP3s are fine and play in windows Mp3, but when I try to bring them into Flash I get a message saying that it can't import them and does not say why. I have looked at this but impossible to find an answer, I work with windows 7, flash Cs5 64 bits in actionscript 2.0 and I do not have a good editior just flash.
-Thank you
This usually means that there is a problem of sampling rate.
Load your mp3 into a sound editor and then export it using the standard settings.
-
Merge data into InDesign with Hebrew characters
InDesign CC 2014 on Windows 7 Ultimate
I had an Excel file which contains mainly in English, but has a few words of Hebrews here and there. I was unable to save as a CSV file retaining the Hebrew from Excel, so I downloaded Google leaves and downloaded in CSV.
When I open the CSV file in Notepad, it looks perfect with Hebrew, although if open in Excel the characters are distorted.
When it is used to merge data into InDesign, the Hebrew characters appear as such mutilated versions only displayed in Excel.
I use GREP to format the Hebrew characters.
I have a feeling that the problem is at the "save CSV" step, but I do not know how to remedy this.
Any help much appreciated.
Thank you
Ruth
Instead of changing the file extension, try saving the text with UTF-8 encoding.
Excel: Save as type > text (separator: tab) > Tools > Web Options > Encoding > Unicode UTF-8
-
Insert data into Oracle DB from MS Access Forms
Dear professionals,
How to insert data into the table that reside in the Oracle DB through MS Access forms?
We have already created ODBC link tables Oracle allows you to select data, and it works.
Unfortunately, we can select only the data, but insert, delete and update are not available via MS Access form, even if the user has all permissions on the oracle DB (grant select, insert, update, delete on oracle_table to access_user).
driver: Microsoft ODBC for Oracle
MS Access 2003
Oracle DB 10.2
THX in advance,
AdnanOne would need to know what means "not available". You get a specific error? As far as I know your statement is simply incorrect.
There are perhaps incompatibilties between DLLs Microsoft and Oracle, I would avoid the Microsoft ODBC for Oracle driver like the plague!---------
Sybrand Bakker
Senior Oracle DBA -
Import Excel data into Dreamweaver
Hello everyone, I'll try to be as descriptive as I can with what I want.
In short: I would like to be able to have the date of importation of Dreamweaver (CS5) of cell A1 in the html code.
More details: I have an ever-changing list of links that I would like the list to a Web site. And have auto update it in dreamweaver everytime I update the list in excel
for example, I put in Dreamweaver < a href = "(insert)" > link 1 < /a >
where see you (insert) I would like to be able to import the address of the link I have in cell a1 in my Excel spreadsheet.
So overall I would like
< a href = "(insertA1)" > link 1 < /a >
< a href = "(insertA2)" > Link 2 < /a >
< a href = "(insertA3)" > link 3 < /a >
etc.
How can I tell Dreamweaver to insert this single cell in the spot in html and then move on to the list of others the same way?
I am a novice with html, css, so I use Dreamweaver for the first time to try to make this a little easier to follow.
> Using a database that I would be able to choose certain sections of the list to be used by page
Sure. Your table may contain a column that specifies what (category) page the link should appear on. Your request for this page would include a filter that returns only relevant links.
> What would you suggest that I use to create data bases?
You would use any DBMS provides your host. Most likely, this will be my MySQL.
-
Load data into Essbase with EAS (no space available on the device)
Hello
I exported all Essbase database data in a text file with EAS. The size of the file is 1.6 GB autour
I want to load it into the same database on another server with EAS. And each time around 55%, EE gives me the error "No space" available on the device [ServerB]
Here is the configuration:
-Essbase server: 11.1.1.3 on a linux server has (enough space left for Essbase)
-Server EAS: 11.1.1.3 on a linux server B (enough space for the data file)
-EAS Client: 11.1.1.3 on my computer (Windows)
-Data file: on my computer too
Error messages tells me that there is no space left on the service Regional Server.
Do you know where EE server temporarily load the data file before sending it to Essbase? So, I can increase my file system.
Thanks for your help.Why don't you just copy the export more to the essbase server, personally I would not even try to send this amount of data over a network through the Regional service.
See you soon
John
http://John-Goodwin.blogspot.com/ -
Import of the DMP Oracle with the unknown schema name
Hello
I need to import a DMP Oracle DBMS Oracle 11g by the SYSTEM. I don't know what patterns are stored inside.
How can I get information, schemas are stored in the Oracle DMP?
Thank you!
DejanYou can check the conent of the bucket to help
IMP usernmae/password file = log = show = Yes full = yes
You can view the log file. It will import all the data, but gathers the information in logifle.
Anil Malkai
-
Load table data into Oracle Essbase
Hi all
I have a problem
1 oracle table have 50 million records
Essbase load data from that
ODI error message:
Caused by: java.sql.BatchUpdateException: means: Java heap space
at org.hsqldb.jdbc.JDBCPreparedStatement.executeBatch (unknown Source)
at oracle.odi.runtime.agent.execution.sql.BatchSQLCommand.execute(BatchSQLCommand.java:44)
at oracle.odi.runtime.agent.execution.sql.SQLExecutor.execute(SQLExecutor.java:102)
at oracle.odi.runtime.agent.execution.sql.SQLExecutor.execute(SQLExecutor.java:1)
at oracle.odi.runtime.agent.execution.DataMovementTaskExecutionHandler.handleTask(DataMovementTaskExecutionHandler.java:87)
at com.sunopsis.dwg.dbobj.SnpSessTaskSql.processTask(SnpSessTaskSql.java:2913)
at com.sunopsis.dwg.dbobj.SnpSessTaskSql.treatTask(SnpSessTaskSql.java:2625)
at com.sunopsis.dwg.dbobj.SnpSessStep.treatAttachedTasks(SnpSessStep.java:577)
at com.sunopsis.dwg.dbobj.SnpSessStep.treatSessStep(SnpSessStep.java:468)
at com.sunopsis.dwg.dbobj.SnpSession.treatSession(SnpSession.java:2128)
to oracle.odi.runtime.agent.processor.impl.StartSessRequestProcessor$ 2.doAction(StartSessRequestProcessor.java:366)
at oracle.odi.core.persistence.dwgobject.DwgObjectTemplate.execute(DwgObjectTemplate.java:216)
at oracle.odi.runtime.agent.processor.impl.StartSessRequestProcessor.doProcessStartSessTask(StartSessRequestProcessor.java:300)
to oracle.odi.runtime.agent.processor.impl.StartSessRequestProcessor.access$ 0 (StartSessRequestProcessor.java:292)
to oracle.odi.runtime.agent.processor.impl.StartSessRequestProcessor$ StartSessTask.doExecute (StartSessRequestProcessor.java:855)
at oracle.odi.runtime.agent.processor.task.AgentTask.execute(AgentTask.java:126)
to oracle.odi.runtime.agent.support.DefaultAgentTaskExecutor$ 2.run(DefaultAgentTaskExecutor.java:82)
at java.lang.Thread.run(Thread.java:662)
I think that Agent Load data so great, if memory cannot load.
How to fix?
Please give me a solution.
Thank you
As Craig said, move the staging area out the SUNOPSIS MEMORY ENGINE initially. This should only be considered if you are mobile / transform small amounts of data (including 50 million lines isn't :-)).) Why you do not set the staging on your Source Oracle DB in this way, you remove an unnecessary data movement i.e. the LKM and don't rely on memory in engine.
-
import schema data using oracle data pump
Hi all
I want to import a schema on a single server using IMPDP. But on this server, the user does not exists.is it is possible to import all the objects that break including the creation of the schema. In exp/imp, it may be possible. But in data pump I can't do the same. Its giving error that the user does not exist. For your reference, I'll give you the code below the import.
Impdp system directory = DIR_DUMP logfile = expdp_tsadmin_tcgadmin_11182013_2_2.log
dumpfile = expdp_tsadmin_tcgadmin_11182013_2.dmp PATTERNS = TS_ADMIN version = 10.1.0.2.0
Pls help and thanks in advance.
Thank you
Piku
Hello
All errors are due to the fact that the tablespace that ts_data does not exist, everything else is hit because of this.
create tablespace ts_data datafile 'xxxxxx' size xM;
then try again
See you soon,.
Harry
-
Error when using SQL Developer to IMPORT access data in Oracle
Hello
I use SQL Develoepr to export the Access mdb file to Oracle. When I try to use the tools -? Migration-> Microsssfot-> export access
I get an error message to attach the Access database file, the error indicates
"Error #40179 - XMLExporter - Methiod 'AddFromFile' of object ' _References failed." Export failed.
What could be the reason for this error please notify.
Thank youDon't know if it is related to your question, but you need a JDK 1.6 (Java SDK). What do you get in Help - about - Version?
K.
Maybe you are looking for
-
When I send an iMessage since my iPhone 6 to my friends android, that it appears as a VZWpix.com email. Why?
-
Recovery of 1178sa HP ENVY m6 spoil
Hello So I have my hp ENVY 1178sa m6 about four months, its 8 64-bit Windows. So the first problem was when I was doing the recovery disks it kept stopping and telling me to put in a new drive. I got the first disk on five fact. Then I started gettin
-
Laser jet mfp m177fw pro: Customize the paper size
How do customize you printer for paper for example size 7.25 in x3.5in none of the predefined options is pretty close to this size.
-
How do know you if there is a webcam on your computer
How do know you if there is a webcam on your computer?
-
Network Concentrator VPN access.
We have a 3000 Concentrator and is configured with a remote vpn on it. All inside network is allowed once a connceted to the vpn user. It is quite behind firewalls. I can access an external IP. But I can't log in to the vpn from the inside network. I