should I turn off my IKM for faster migration update if I have static data?

I have no much experience with ODI and I know that sounds like a very long explanation, but if you have experience using ODI respondent should not be that difficult, please bear with me on this one...

I move data between Postgres, Oracle 12 c. Use my interfases: incremental update for IKM Oracle and IKM Oracle incremental update PL SQL (using long data types). The tables are in the order of several hundred million of 100 million more 500 million lines from wherever we have to run the interfases as soon as possible. Because of my inexperience with ODI, I'm not sure if I select the right options to run the interfaces:

1 as soon as possible

2 - with the possible minimum measures

The aim is only to move static data to Postgres to Oracle, that's all. (there is very few transformations, for most of the castings to force data to a certain type of data)

With my current selections, the IKM Oracle incremental update (PL SQL) ODI does the following:

-working table, create work table C$ _0 < TABLE TARGET - >

-working table charges <-this step loads the postgres data in the oracle table... <-that's ALL I NEED! .. .load of Postgres to Oracle...

-creates the flow table: I have$ _ < TABLE TARGET - >

-then using a cursor selects all data from the TABLE of WORK C$ _0, load: I have$ _ < TABLE-TARGET > <-is there a way to avoid all these additional tables?

-create indexes and statistics on I$ _ < TABLE TARGET - >

-flags of lines for the realization of the update if the lines already exist in the < TARGET > TABLE

-Using a cursor selects all I$ __ where IND_UPDATE = 'I' and inserts data into the TABLE < TARGET > < TABLE TARGET >

My data source are static and its integrity is verified by FK in Postgres, so I'm not worried about the quality of the db of the source, to the IKM my options are:

Insert is: TRUE

Update: TRUE <-would it be wrong? (I think this one can be false for me because my source table is static and my target doesn't support only once for the first time is always empty table)

flow control is FALSE

static control is FALSE

Has. are all of the options to reduce the steps performed during the interface? (it seems I need to UPDATE set to false on the revenge for each interface)

I load a table with 110 millions of rows, work began in 24 hours. To load the table of Postgres to Oracle took 4 hours and 10 minutes, but to load the flow table (PLSQL cursor) took more than 20 hours for barely half of labour (52 million lines)

All the data I need is on the work table, I can stop the interface and rename the columns but I wonder... B. what is the right action to take here? how to change the settings of the ODI, so they just move the data from the source to the target only and avoid any other measure reducing the total execution time.

C. the server has 32 processors, but ODI seems to use one. How can I take advantage of the CPU?

Thanks for your help.

P.S. I have read all the documentation there, but it is difficult to get concrete responses with no experience using the product and no other indication. I'm learning to use the tool by using the documentation only.

Hello

I would check this vlog by Craig Stewart first to see if can do you need:

http://odiexperts.com/direct-load-by-interface-with-no-work-tables/

Otherwise, there are a few points I would make:

You use the bad IKM with a cursor, if you load Oracle and you want to insert / update, then I always would start by merging first.

Second, feel free to hack the km to get what you want (always duplicate an existing and start from there, he avoids you to come once upgrade). If you look at the LKM, the insert in $ CAN use a different API call to get table name of $ CAN, you can always get the name of the target table (see the appropriate step of revenge for syntax) and to use it in the same place (perhaps to tweak the getColList in the same way) I've done it before - I created a LKM to write directly in the target table , I need an IKM has nothing so used a dummy not (interface complains with no set IKM), not to the customer more, don't have it to hand, but I'm willing to help if you want to PM me.

For Question C - seems you want o use parallelism, see the Oracle documentation first to get on the same page. You need optimizer parameters set correctly and your tables must be created with parallel hint in the DDL (maybe need to change any ODI create table steps accordingly).

Try to get the optimizer to get correct PX parameters before you use to alter session strength parallel etc etc.

Rgrds

Alastair

Tags: Business Intelligence

Similar Questions

  • ENVY 15: Turn off Adaptive display for ca mode

    Hello

    I'm in the curiosity of how I can turn off Adaptive brightness for the external mode display.

    http://i.imgur.com/nnDnd9Y.jpg

    I already turned off in Power Options in Control Panel. Initially, it wasn't only to turn off Adaptive brightness so I also disabled display Power Saving Technology for battery operation of the Intel Graphics Control Panel.

    It works like a charm for Adaptive functioning on battery power but display is always active when the external power and I couldn't find an option to turn off in Intel Graphics Control Panel, there is no display of techniques for saving power for external power.

    http://i.imgur.com/WtLe6kB.jpg

    So, how can I stop the Adaptive brightness for current alternative before going blind in the sudden brightness changes when I am plugged into the wall?

    Any help is appreciated.

    Thank you!

    Hi @yldzanl ,

    Thank you for visiting the Forums HP's Support and welcome. I looked in your question about your HP ENVY 15 laptop and wanted to turn down the brightness in AC mode. On your first page it shows you in editing parameters. You will notice that the brightness level, one for battery mode and the other for the AC adapter / CC, they are not the same.

    Change this to be the same for the battery and save the settings.

    Thank you should take care of it.

    Thank you.

  • Should I turn off my Apple TV 3 when I turn off my TV?

    Should I turn off my Apple TV 3 when I turn off my TV?

    Honestly, no! There is really no need because it stops automatically after an hour of idle time.

    For permanently off it just to remove the power connector!

    There is also a setting in the Apple TV to control when he sleeps under general settings.

  • BlackBerry Smartphones how can I turn off sync wireless for spots on my BlackBerry Bold 9780?

    I turned off Wireless Sync for Contacts, calendar, and memos, but I can't find a place to disable the tasks. How can I do this so I can synchronize tasks as well when I connect my phone to my computer?

    Furthermore, I've never seen a list of tasks is displayed on my BB, even if I am able to create tasks. Should I see it on my screen with the list of the recent emails, upcoming appointments and missed calls?

    I finally got the answer from another forum.

    The task app is under Applications. Then press the BB button to open the menu and select Options. Wireless Setup is here.

  • Should I turn off wifi router every time I sleep?

    7 or 20:00, I intend to turn off the Wi - Fi router, but if she is up to date, if it brick my Mac if it is updated to the software? Will this affect my iPhone? Should I disable the Wi - Fi router automatically every day or its not recommended.

    Why you would make her at all? Mine has not been turned off over the years. Do NOT turn off it if she or any equipment to which it is updated.

  • Should I turn off the keyboard and bluetooth mouse off?

    Hello

    I'm new to Apple products and have recently purchased an iMac with keyboard and mouse compatible bluetooth.  The are a switch on each accessory to activate the bluetooth on or off.  Should I turn off after closing down to save the battery power or not this wear simply on the switches.  Not sure if stop actually stops transmitting wireless accessories, or if the latter uses the negligible power when the computer is turned off.

    Thank you

    JosfromSydney

    JosfromSydney wrote:

    Hello

    I'm new to Apple products and have recently purchased an iMac with keyboard and mouse compatible bluetooth.  The are a switch on each accessory to activate the bluetooth on or off.  Should I turn off after closing down to save the battery power or not this wear simply on the switches.  Not sure if stop actually stops transmitting wireless accessories, or if the latter uses the negligible power when the computer is turned off.

    Thank you

    JosfromSydney

    Yes switches turn off the wireless, and yes they use negligible power when the computer is turned off.

  • Should I turn off the keyboard and mouse after use or leave?

    I find it annoying to switch the keyboard power continually because of the password on and off.   Wouldn't be much difference to the life of the battery to let both mouse and keyboard lights permanently?

    I have never turned off the mouse or the keyboard. The batteries have been used for about a month, with the mouse to 60% and the keyboard to 90%.

  • How to turn off the microphone for sony hdr-pj260v

    How to turn off the microphone for sony hdr-pj260v

    Hi dstrakal,

    Option to disable the built-in microphone is not available in the camcorder. However, the camcorder has an input jack to connect an external microphone, there are two possible solutions for this:

    1. Connect a microphone with a switch ON / OFF the microphone on the camcorder decision-making. Then, set the switch to the external microphone to the OFF position. This will disable the microphone on the camcorder.

    2. Connect a dummy stereo mini plug to the microphone on the camcorder Jack.

    If my post answered your question, please mark it as "acceptable Solution".

  • cannot turn off auto-renewal for any reason any

    I can not turn off auto-renewal for any reason because when I click on change it takes me to a page asking to put a code that was sent to my email and I'm not sure yet what the good e-mail even if I changed the security evidence and I'll go and contact Xbox , but this is a last resort

    Your best bet would be to contact Xbox support or use the Xbox forums.

  • turn off the "allow for remote assistance" setting prevents someone view my computer remotely?

    original title: Hi, I wonder, if someone has access to my ip address and I want to prevent them from view remotely or even control my activities, turn off the "allow for remote assistance" setting prevent from coming into my computer?

    Hi Dom.A


    Yes, if you have given access or invited a person to have access remotely from your computer, then definitely disabled this option helps you. Refer to the following links for assistance on the question and check.
    http://Windows.Microsoft.com/en-us/Windows-Vista/Windows-remote-assistance-frequently-asked-questions

    http://Windows.Microsoft.com/en-us/Windows-Vista/what-happens-when-I-enable-Windows-remote-assistance

     

    I hope this helps.

  • Should I turn off (disable) adobe on the computer program, it is. Until the program is installed on a different computer

    Should I turn off (disable) adobe on the computer program, it is.

    Until the program is installed on a different computer

    inaktivera.JPG

    It should be disabled on one of two computers so it can be activated on a new computer (which is the limit max of two activations).

  • Error in Photo Story 3 - "an error has occurred and should be closed. We apologize for the inconvenience. Results may have been lost.

    Original title: Photo Story 3 for windows
    try saving the photo story 3 project in order to proceed to the next time. Message that appears:

    "In Photo story 3 for w. an error has occurred and should be closed." We apologize for the inconvenience.  Results may have been lost.  You want to send a report? Yes/No"(from Microsoft). (But a response never happens). Does anyone know how to help out me?

    Hello

    You try to save the projectas a project .wp3 file or a .wmv movie file?

    Try to save the file as a .wmv file and check if the problem persists.

    To record a movie .wmv file that should play in Windows
    Media Player:
    a. After you have finished working on the project, when you get to the option "what do you do with your story.
    Select this option, "record for playback on your computer.
    b. Select a location.
    c. click Next.

    Kind regards
    Afzal Taher - Microsoft technical support.
    Visit our Microsoft answers feedback Forum and let us know what you think.

  • Can I turn off the sound for a website but not computer?

    I like to play POGO games all of which come with a certain type of sound effects, but at the same time, I like to listen to my radio station streaming favor. How can I disable the sound for Web sites but not my music streaming?

    If it is an individual, video or audio on a web page, you can try to turn off or disable the audio using the audio and video controls on the web page, or you can install an extension that adds this functionality. It is called mute, and you can install it from https://addons.mozilla.org/en-US/firefox/addon/muter/

  • How can I turn off Compatibility Mode for a program that does not require it?

    I loaded iTunes 9.1 program has 64 bit for Windows 7. When I open it, I get a message that the program has been set to run in compatibility mode. He then States for best results, turn off the compatibility mode for itunes before you open it. How can I turn off compatibility mode?

    Hello Wynn 1,.

    Article Apple: http://support.apple.com/kb/TS1489

    Try the following steps to turn off Windows compatibility mode:

    1. Quit iTunes.
    2. Windows XP and Windows 2000: on the Start menu, click my computer (or double-click my computer on the desktop).
      Windows Vista and Windows 7: on the Start menu, click computer.
    3. In my computer, open the drive C:\ (or according to your drive Windows is installed on).
    4. Open the Program Files or "Program Files (x 86)" folder if you use a 64 bit version of Windows Vista or Windows 7).
    5. Open the iTunes folder.
    6. Right click on the app to iTunes (iTunes or iTunes.exe) and in the context menu, clickProperties.
    7. Click on the Compatibility tab.
    8. If it is checked, uncheck the box under compatibility mode.
    9. Click OK.
    10. Open iTunes and play a song.

    I hope this helps.

    Sincerely,

    Marilyn
    Microsoft Answers Support Engineer
    Visit our Microsoft answers feedback Forum and let us know what you think

  • Turn off the UAC for a SINGLE PROGRAM

    Hello!

    I have a question:

    I have a program that must be run as an administrator. I often open it, so I put that it is running as an administrator when I click it it is shortened. However, whenever I launch, the UAC prompt appears.

    Can I turn off UAC for this program? I don't want to disable UAC completely. If this is not possible, can I put it in a setting where it will not encourage me during the execution of the programs as an administrator?

    Thank you

    RyKona

    If we could turn off UAC for pirated programs would have a field day. UAC is either activated or not - there is nothing in between.

    Why you need run this application under elevated privileges? Sometimes there are alternatives that work without elevation.

Maybe you are looking for