Performance problem of the migration of more than 500 million using OWB records.


I need to migrate 500 millions of records. The structure of the table is similar to the table of scott.employee with the only exception being that the HIREDATE column is NOT NULL. The table is partitioned by using month-wise column HIREDATE. The target table is the same as the source.

I used a direct correspondence with the approach based on the game but it run for more than 10 hours. I then tried to create another temporary table to store the date. I've first grouped column date and got the number for number of records by date. I have it stored in a temporary table. Then I took the first 10 dates and it is attached with the source table and inserted the result set into my target table. The performance is slightly better but still not acceptable.

Can someone please help?

I have the necessary indexes in place and oracle is using them. I don't know a lot about the ELP language (using OWB 10 g 2 and so I can use it), but if I understand good documentation, it changes the identity simply and does not move the data. In this case, I can't use it because I want the source data too.

You will appreciate all the assistance. Thanks in advance.

Concerning

I ask you to remove data from the source.

All I'm asking is:
you said that your target tbal has all the lines.
So instead of insert source to target why not make your transformation on the source table and rename the source table to target the tbalename and remove the taret table and build your constraints on source table IE

Staged tbal - CBC - 500 million lines
Target - TGT - 0 rows table

create the table src_copy in select * from src - so now you have a copy of your table in the source
do your cleaning on lines 500 million on the table of data src_copy
build constraints on table src_copy
drop table tgt
Rename src_copy table table tgt.

Do not see a problem in doing this.

Tags: Business Intelligence

Similar Questions

  • Re: Problem with downloading the files of more than 500 k, YES KB

    Hey you,.

    I wanted to upload files in my email account, but it still fails.
    Could someone help me?

    I use a stick of the internet on a Satellite U900-12J.

    It does not work with Filezilla, Google, Chrome, Thunderbird,..., only wiorks for the small download size of FTP data.

    Hey you.

    First a U900 Sat does not for me and I doubt s exists
    Second, I doubt it s a cell number.

    You should get in touch with your e-mail account provider and should ask why the files larger than 500 KB are not possible

    Big names

  • Oracle to send email with the size of the content of more than 32 k using UTL_SMTP

    Hi all

    I Googled, and also searched the oracle forums and I did not find a good link to see when dealing with sending e-mails with content size over 32 k using UTL_SMTP. If someone can you please direct me to some links that would be a great help.

    Thank you

    Rambeau

    It's because you first set 'Hello World,' mailBody (mailBody.COUNT) and then immediately replace by "test sample". Maybe you wanted to EXTEND between postings...

  • Several files of more than 500,000 KB in the c:\windows\temp folder

    More than 500,000 Ko I have several files in the c:\windows\temp folder. They are all named as TOP * .tmp and are all together like 7 GB.

    Issues related to the:
    1. What is UPSTAIRS * .tmp files?
    2. may I remove them?
    3. If Yes, do, I lost?

    OS: Windows Vista editions Home Premium on Sony Vaio VGN-NR11Z

    More information about the files:
    ------------------------------------------------------------------------------------------
    System - folders for temporary files 7.847.221 826 KB
    ------------------------------------------------------------------------------------------
    C:\Windows\TEMP\TOPF54E.tmp 532,249 KB
    C:\Windows\TEMP\TOPF310.tmp 532,249 KB
    C:\Windows\TEMP\TOPE604.tmp 532,249 KB
    C:\Windows\TEMP\TOPCD63.tmp 532,249 KB
    C:\Windows\TEMP\TOPC151.tmp 532,249 KB
    C:\Windows\TEMP\TOP71FD.tmp 532,249 KB
    C:\Windows\TEMP\TOP7107.tmp 532,249 KB
    C:\Windows\TEMP\TOP6D2F.tmp 532,249 KB
    C:\Windows\TEMP\TOPB901.tmp 329,440 KB
    C:\Windows\TEMP\TOPC7B3.tmp 329,344 KB
    C:\Windows\TEMP\TOPC503.tmp 329,344 KB
    C:\Windows\TEMP\TOPB854.tmp 329,344 KB
    C:\Windows\TEMP\TOPAB02.tmp 329,344 KB
    C:\Windows\TEMP\TOP5D30.tmp 329,344 KB
    C:\Windows\TEMP\TOP5996.tmp 329,344 KB
    C:\Windows\TEMP\TOPC7C8.tmp 186,240 KB
    C:\Windows\TEMP\TOPC47D.tmp 186,240 KB
    C:\Windows\TEMP\TOP9AFC.tmp 186,240 KB
    C:\Windows\TEMP\DZSEFDA.tmp 155,840 KB
    C:\Windows\TEMP\TOPCA78.tmp 113,280 KB
    C:\Windows\TEMP\TOP9BFB.tmp 93.312 KB
    C:\Windows\TEMP\TOP99C8.tmp 93.312 KB
    C:\Windows\TEMP\TOP863B.tmp 93.312 KB
    C:\Windows\TEMP\TOP490D.tmp 93.312 KB
    ...

    All ALBUMS * .tmp files have now updated the 25.10.2009 and about the same time.

    Thank you for your response.

    Kind regards
    Andrej

    Hello

    Thank you for the additional information.

    Yesterday, I decided to register on IT * files .tmp on DVD and I removed them from the TEMP directory. I decided to do it because none of the processes they used at the time of my comment. I compared the the event logs for any new warnings or errors, but mistakes are appearing as before removal. The errors are:
    -The parallel port driver service failed to start due to the following error: the service cannot be started, either because it is disabled or because it has no enabled devices is associated to him.
    -Could not load the plug-in module. (GUID = {56F9312C-C989-4E04-8C23-299DEE3A36F5}) (Error code = 0 x 80042019)

    I haven't checked on the first error, but it appears in the system log because I erased the corrupt system log - also before deleting the files.
    The second is well known 'Vaio Entertainment Database Services' error (in the application log) and everyone invites you to remove this service from startup list. So maybe I'll do it.

    My Vaio has now extra 7.5 GB of free space and has no performance or other problems (so far).

    Today, I tried this (sfc/scannnow) system scan and the log is perfectly clean. Nothing has been repaired.
    Also checkdisk returns nothing abnormal so I think the albums * .tmp not fail at any other SW. The other issue is how they were created, but as my log files have been corrupted (another known problem of vista), I will probably never know the answer.

    If new sth will appear on the subject (e.g. new TOP * .tmp files), I'll write again.

    Thank you once again.

    Andrej

  • When I click on close downcomputer the hourglass appears on the desktop for more than a minute before the closing down of the icon is displayed

    When I try to shut down my computer, I click on start > click on computer of closing and the hourglass appears on the Bureau for more than a minute, when the close icon appearsand I click on it, it takes about 2 minutes to turn off actually. Any suggestions

    We need more information!

    Borrowing another post by ElderL (the same "JoseIbarra' that Elizabeth23 already mentioned):
    Provide information on your system, the better you can:

    What is your system brand and model?

    What is your Version of XP and the Service Pack?

    What is your Internet browser and version?

    Do you have the Windows Desktop Search installed issue?

    Your system's disks IDE or SATA drives?

    Describe your current antivirus and software anti malware situation: McAfee, Symantec, Norton, Spybot, AVG, Avira!, MSE, Panda, Trend Micro, CA, Defender, ZoneAlarm, PC Tools, Comodo, etc..

    The question was preceded by a loss of power, aborted reboot or abnormal termination?  (this includes the plug pulling, buttons power, remove the battery, etc.)

    The afflicted system has a working CD/DVD (internal or external) drive?

    You have a genuine XP installation CD bootable, which is the same Service as your installed Service Pack (this is not the same as any recovery CD provided with your system)?

    What do you see (exactly) that you don't think you should see, and when you see it?

    What do not you think that you should see?

    If the system works, what do you think might have changed since the last time it did not work properly?

    ___________________________________________________________
    Once you answer these questions to the best of your ability, a lot of people here (don't forget that almost all of us are volunteers who are also using Windows XP) will probably be able to help quickly resolve your problem.
    That (ElderL also) might help, too (because its results will contain many answers to the above questions):
    Click Start, run and enter in the box:

    Msinfo32

    Click OK, and when the system info summary appears, click on edit, select all (Ctrl-A), copy (Ctrl-C) and paste (Ctrl-V) the information back here in your next reply.

    For video device and driver information, expand components, click view, click on edit, select all, copy and then paste the information here.

    There will be some personal information (such as the user name and the name of the system), and anything that turns information private for you, simply delete the pasted information.

    This will minimize back Q & A and eliminate guesswork.

  • My computer is not connected to the internet for more than 2 minutes both

    my computer is not connected to the internet more than 2 minutes at a time

    Hi Ronda,

    Thanks for choosing the Microsoft Community forums.

    I see that the computer is not connected to the internet for more than 2 minutes on Windows 7.

    To help you better, please answer this question.

    Did you do changes on the computer before the show?

    I suggest you follow the provided methods to solve the problem.

    Method 1:


    Please see the knowledge base article:
    How to troubleshoot network connectivity problems in Internet Explorer

    http://support.Microsoft.com/kb/936211/

    Method 2:

    You can make sure to uncheck the following option in the network adapter properties in Device Manager.


    "Allow the computer to turn off this device to save power".
    You can see the steps
    a. Click Start, the Device Manager in the area start search, type and then click on Device Manager in the list programs.
    b. If you are prompted for an administrator password or a confirmation, type your password or click on continue.
    c. in the Device Manager dialog box, expand network adapter, click the network adapter and then click Properties.
    d. in the network adapter properties dialog box, click the power management tab. The allow the computer to turn off this device to save uncheck box appears

    Method 3: Problems of Wi - Fi network and

    http://Windows.Microsoft.com/en-us/Windows/network-connection-problem-help#network-problems=Windows-7&V1H=win8tab1&V2H=win7tab1&V3H=winvistatab1&v4h=winxptab1

    If you need help with the Windows operating system, just tell me and we will be happy to help you.

  • Increase the search results to be more than 500

    We have a requirement of use to increace the search results for any type of technique to over 500 (now the set limit). Is it possible none in the system?

    This limit is in place for performance reasons and cannot be rid of basic research.   However, usually when users want more than 500 results is because they are tasks considered compared to standard search/navigation tasks.   For tasks in report, we published reports ready.  Ready reports offers the same features that the search you can adjust the limit of 500 and run saved contextual criteria.   Alternatively, you can calm the concern for the performance by implementing enforcement reports, ready to use a reporting database if necessary.

    Reports of loan is extremely simple to install.  You can learn more on this topic by watching the video of presentation on the collaboration site.  You can also read the guide that is located in the pack of extensibility.

  • My MacBook Pro was built in mid-2009, I understand that I won't be able to get the next Sierra of OS.  I just put a new hard drive 700 GB, more I added a new battery to include a new CD/DVD drive.  I spent more than 400 million dollars. What I need to by

    My MacBook Pro was built in mid-2009, a 2.6 GHz, 13-inch, I just put a new hard drive 700 GB and I added a new battery to include a new CD/DVD drive.  I spent more than 400 million dollars.

    I understand that I won't be able to get the next Sierra of OS. I need to by a new Mac?

    Talk to the people the more I would get if I turn in I'd get is about are about $ 100 million.  Please tell me it isn't so.

    If you want Siera you will need a new Mac, but you can continue to use the old one as long as you want.

  • I just signed up for the storage of more than my iPhone. I buy separately for my iPad?

    I have just signed up for the storage of more than my Iphone... I buy separately for my iPad?

    < re-titled by host >

    iCloud-storage can be used by multiple devices as long as they use the same identifier Apple to settings > iCloud. The main orientation of iCloud's for the synchronization of data between the devices.

  • Satellite Z830 - I wonder if the motherboard supports more than 6 GB of memory

    Hey, I bought a Toshiba Satellite Z830-10w. It's a fine ultrabook.
    I wonder if the motherboard supports more than 6 GB of ddr ram.

    Have some of you tried it with a block of 8 GB of RAM Regand flemming

    > I wonder if the motherboard supports more than 6 GB of ddr ram.

    The chipset is responsible for the RAM
    Therefore, know if the chipset would support the 6 GB of RAM.

    Z830-10w supports the Intel HM65 Express Mobile Chipset and it should support the 8 GB of RAM

    To my knowledge the unit is equipped with a 2 GB internal RAM that is NOT removable.
    You can update ONLY one slot
    So one slot can handle 4 GB of RAM, and in this case the 6 GB of RAM are supported.

  • How do you decommssion a domain controller that has not been on the network of more than 200 days?

    Hello

    in our society, we have an old domain controller has been disconnected for more than 200 days, probably in a State of thumbstone, it still appears in our network. We wanted to know what is the best way of disused this server, we connect to our network and do normal downgrade process.

    How do you decommssion a domain controller that has not been on the network of more than 200 days?

    Could you please write me back to my work email or call me on my work phone? Job information are below.

    Hello

    The business support, you can find forums on TechNet, see the following links:

    http://social.technet.Microsoft.com/forums/en/category/WindowsServer/

  • Why am getting started on the internet with the message saying that more than one computer using the same ip address

    am is started from the internet for 3 days pass with the message saying that more than one computer using the same ip address

    am is started from the internet for 3 days pass with the message saying that more than one computer using the same ip address

    Thatmessage normally means a another computer on your local network has the same IP as the computer you are on.

    You control your Local network?

  • I had to reformat my computer and lost all my window 8 games. The store has more than some of them. Is it possible to find?

    I had to reformat my computer and lost all my window 8 games.  The store has more than some of them.  Is it possible to find?

    Original title: Lost games

    I had to reformat my computer and lost all my window 8 games.  The store has more than some of them.  Is it possible to find?

    Hello

    Your Store account is independent of any installation of Windows 8. If you have downloaded or bought all the apps store, this information is saved in the store.

    To reinstall your applications after reinstalling.

    1. open the store and make sure that you are connected with your Store account (press the Windows key + I, then select your account).

    2 on the main screen, right click and select your applications on the top toolbar.

    3 in the drop-down Menus, select applications and the sort by name.

    4 in the results, click each application that you want to reinstall , and then click the icon to install the toolbar at the bottom.

    Note: If you have a very large number of applications to reinstall, select a few at a time to reinstall.

    Concerning

  • SQL: how to display the second string of the function in the Jobs table only if the function has more than one string.

    SQL: how to display the second string of the function in the Jobs table only if the function has more than one string.

    Hello

    You can use REGEXP_SUBSTR Oracle/PLSQL: REGEXP_SUBSTR function

    Select the function double REGEXP_SUBSTR('PUBLIC RELATION REPRESENTATIVE ','[^]+',1,2);

    Do you have any value of the column as no 2nd string?

  • Is it possible to find the two sentences into one pdf file? For example, I know the words 'Here' and 'the answer' occur more than once in my document, but only once on the same page. I'm looking for this page.

    Is it possible to find the two sentences into one pdf file? For example, I know the words 'Here' and 'the answer' occur more than once in my document, but only once on the same page. I'm looking for this page.

    I tried to do this by using the search but it will find only them, if they occur as a long chain, that is to say "Here's the answer" rather than how they occur in the document it is to say "Here 's" a bunch of information that leads you to 'the answer'. The search feature so standard did not help.

    Then I tried to do this by using the tool to delete (obviously not the application of writing!) because it allows me to search for multiple words or phrases, however it is not highlight what page both are found. I tried to turn on the preference to enable deletions of comments and even if it meant that I could then go through all the comments, it's still not faster than my document is more than 1,000 pages, which meant there were too many total comments for me to be able to easily identify which page had both.

    Any ideas?

    There is no built-in way to search for two strings and limited to show only the results that appear on the same page.

    It can be done by using a custom script, however.

Maybe you are looking for