Performance in ODI 11 g problem

Hello world

I created an interface, where source has 2 has no records and I used the incremental update of Oracle IKM.

When I ran at full load it loads data into the target in a few minutes.

When I ran the next day to delta load taking 1 hour for load data into the target.

How to solve this problem please help me.

Hello.

There are a few things that you can play around incremental IKM to tweak it to make it run faster...

* The first thing you will need to manually identify which generates ODI as sql code. If you don't like or don't know, then next step is to look at a few option that you can change to IKM level.

The underside of my discoveries... in order to choose who should be.

Solution 1: The best approach is to CDC, but I say again, I use the Golden gate for CDC + ODI for normal load combination (but you must have additional licenses for goldengate)

Solution 2: Always check your value for the option of screening strategy, if you see a NOT EXISTS clause in sql generated by ODI, then better change detection at LEAST stragety. It will be faster to NOT exist.

Work around 3: understand actuall incremental update, it will check all the lines from the source to target based on PK which is defined on the data store target, some of the IKM do it line by line, some of them by Setbased.

so try to put the detection strategy option in an incremental update IKM votes to ZERO and then try... This means that... ODI will now try NOT to compare source and target again data for those rows that are already in the target...

Knit approximately 4: try incremental update of revenge (FUSION) instead of the IKM incremtal update, as merge IKM will be club all operations update/insert in a single step, but not the same case in incremental update IKM.

Hope this helps

Concerning

ASP.

Tags: Business Intelligence

Similar Questions

  • Performance wireless on Satellite P200 problem

    Hello world

    I decided to join this community because I'm looking to solve a pb on my WiFi connection.
    Last week, I bought a Satellite P200.
    OS: Vista
    Wireless LAN: Atheros AR5007EG

    Everything works, but I have a performance problem with the connection.

    This computer is connected to a network of personnel via a linksys WRT54G.
    I have 3 computers (Medion desktop plus 2 other laptops). These 3 computers remains stuck between 3 (WiFi) and 4 (ethernet) Mbit/s on the internet connection.

    The Toshiba receives between 300 and 500 Kbps. It is also very long to detect my network.
    If I connect it by Ethernet: 4 Mbps

    Here is a list of different things I tested:
    -updated drivers
    -test without any key secure over Wifi (WPA - PSK)
    -disconnect avast (or Norton)
    -change the MTU
    -Try a netsh command
    -change of frequency of the signal.

    All ping tests are perfect: it gives exactly the same results as the Ethernet connection. the pb happens only on internet surfing.
    I also try the recovery but the pb is already there when I bought it.

    If someone has a new idea or a trial, it will be great.
    Thank for your attention and sorry for my English (I don't practice for a long time: o)))

    I know Vista's problems if you use the WiFi network.
    This Microsoft article describes the various problems and provides the patch.
    http://support.Microsoft.com/default.aspx/KB/932063

  • Weird performance in a guest VM problem

    Hi all

    Some time ago I P2V' host two machines ed in an ESXI, our domain controller 5.5 and our Terminal Server, I have a SAN on the back-end for the VM (HP2000) through double links 10gbe connections to each host. The terminal server server is very good, running on 1 VCPU 4GIG RAM, I did the domain controller, the rest of the horse power of 5VCPU and 26GIG RAM, DC and TS had thick provisioned (zero lazy) drives a LUN for two disks (boot and storage on both machines), both using a physical NETWORK adapter on the network directly , but the domain controller is to have some performance issues, especially on the network, here's what happens:

    If you ping the server he will answer very well for about 4 times > 1ms then pointing up very high anywhere between 1200 and 3200 ms, and then cycle again, 4-6 pings good and one bad.

    There is an additional wrinkle here, if you are connected to the prompt DC, each 5-10 sec the mouse stops responding, and indeed if for example you don't have installation you can see 'freeze' every 2-4 dry for a brief moment and I had pings run other machines using the domain controller, and you know! Corresponding time, whenever the mouse 'freezes' is when the ping is high.

    This domain controller is also running Exchange them, yes I know that I'm working on the passage to another machine and a file server, but still he worked well on the physical machine. In addition, at the beginning I had 2 VCPU attached to the TS and 4 to the domain controller, I mention this because I saw some Kb articles which suggests that a single machine VCPU (the way I have the TS set up now) get you served first as a a multiple, because of the way ESXI manages CPU loading (he must wait until he has access to all UC 5 to before it will release to) the prompt to use it). I have also seen the principal host items, which is not the case here, I'm still 4 gig of RAM completely unused by the guests, the LUNS have plenty of space both cancelled and put into service (1.36 to 2.1 TB partition vms provisioned Tb) (there is an another 500meg) and I only attributed to real CPU for them , do not use the presented 12 hearts. On Vsphere it does not look to the processors are working very hard at all and memory use is much less than the put into service on the domain controller, 26gig the CPU usage comments spike to 60% from time to time, but once again it is very strange, literally, it seems that the server does some stuff, completely stops for a split second and again There is nothing to note on the logs of the events of the guest.

    I tried to guarantee the time processor to the domain controller and unhooked the guarantee for the TS, nothing helps...

    There are a fair throw more power to this subject (buy us a second processor and maxing out RAM), is completely bogged down changes (don't believe because like I said looks like the machine just stops to do nothing at all for a fraction of a second then continues, this isn't like the CPU cannot follow is that they are not used at all for this moment) (, methinks), should I uninstall all the nonsense of the original machine HP (I obviously useless utility array or one of the probes, of course, although I already stopped all services), what I'm missing here?

    PS > I was able take a small video of the problem, when you see the stop sign, performance indicators that isn't a problem with the video, that's what I see here

    Help!

    So it looks like I'm running on a snapshot (see photo), how do I re-handset/collapse/what you are calling him to the main vmdk file? Even if I have to tell you, the TS began to behave in the same way! Without all the changes and had no made snapshots

    I'm sorry, as I said I am a newbee here, where the var/log directory? I went to the store of data comments (which, in the San) but found no case like this structure? There are log files: vmware - 1.log, vmware - 2.log etc...  Are those that you need?

    Impossible to uninstall the HP stuff now really, cannot restart the server...

  • Performance of OBIEE report initialization problem

    Hi all:

    Thanks for reading this first, please forgive a few appropriate words, I'm not good in English...

    I encountered a problem on the production, when the report is selected, it appears very slow even I made a few adjustments of performance on this report. And after I checked the session, when the report is selected, it works again with some WHAT SQL with each guest has value and it doesn't show any results in the present report.

    So, my question is, is it possible to not run this SQL or y at - it another way to better performance on this report?

    Thanks for answering that.

    I certainly have a lot of suggestions. But to really help, I need a little more detail.

    How different measures do you have in the pivot table? You have all time series analytics in there (as there is or far)? Approximately how many records are displayed in the PivotTable (100, 1,000,100,000)?

    More important still, you followed its use is enabled? If this isn't the case, please turn it on. Blog of John Minkjan here can help you activate it. [http://obiee101.blogspot.com/2008/08/obiee-setting-up-usage-tracking.html]

    If you manage to turn on tracking usage, we can see how much time is spent in the database compared to OBIEE. If it turns out that the bottleneck is the database, then you will need to work with your DBA to set up the database.

    -Joe

  • ODI and Essbase problem

    Dear all,

    I would like to use Oracle Data Integrator to load text files and files to excel essbase cubes.
    How I do that?


    I'm working on Hyperion 11.1.2.1 environment

    Published by: 877916 on December 26, 2011 12:27 AM

    Read my blog, it goes through the steps on the use of all adapters of hyperion in ODI, here is the summary page - http://john-goodwin.blogspot.com/2011/08/odi-series-summary.html

    See you soon

    John
    http://John-Goodwin.blogspot.com/

  • Problems of performance of Premiere Pro, no problem with AE

    Hello

    Recently, when I use Premiere Pro, I seem to have big problems. It runs really slowly, the preview always stutters and some projects with many files imported not even loading. I thought it was my computer die, until I started to After Effects. I thought that After Effects is a much more difficult program for my computer to manipulate than Premiere Pro, but it works quite normal.

    Recently, my laptop has been too hot a lot of times, especially when using Premiere Pro. It automatically shuts off safety. Perhaps because he was running this program, some of the files I messed up because of the heat?

    Is there anyone who knows if it's my problem or if there is another problem that I don't see?

    Many thanks in advance!

    4 GB is really not enough.  I sometimes struggle with 24 GB.

    If you do not intend crop your pix, 5000 x 3500 are great - and the fact that they are 9 mb probably contributes to the problem.  Strip unnecessary pixels - which makes the 72 dpi image.  Which will reduce your pix to about 2-3 MB each.   Reduce them to 1920 x 1080 (if you are not pan and scan)

    You probably also have problems with hard drives.  C is going to be difficult to store temporary files with only 9 GB of available.  Similarly, the D is a tad grating.  Are these disks 7200 RPM?

  • Flashback data archive commit the performance of time - a bug problem?

    Hi all

    I use the Oracle 11 g R2 on 64-bit windows environment. I just want to do some tests quue flashback data archive. I created one and add to a table. about 1.8 million records is to exist in this table. Furthermore, this table is one of the examples of oracle, SH. SALEStables. I created another table using the table and insert the same data twice.
    -- not a SH session
    
    Create Table Sales as select * from sh.sales;
    
    insert into sales select * from sh.sales;
    Commit;
    insert operation takes a few seconds. sometimes, in this code, validation command takes more of * 20 *, sometimes 0 seconds. If validation time is brief after insert, can I update the table and then validate again:
    update sales set prod_id = prod_id; -- update with same data
    commit;
    update takes a few seconds longer. If the first commit (after integration) has had too little time, second validation, after the update, takes more than 20 minutes. At this time, while that commit were working, my cpu becomes overloaded, 100% charge.

    the system that oracle runs on is good for quest staff use, i7 4 real core cpu, 8 GB ram, disk SSD etc.

    When I looked at the Business Manager - performance monitoring, I saw this SQL in my sql album list:
    insert /*+ append */ into SYS_MFBA_NHIST_74847  select /*+ leading(r) 
             use_nl(v)  PARALLEL(r,DEFAULT) PARALLEL(v,DEFAULT)  */ v.ROWID "RID", 
             v.VERSIONS_STARTSCN "STARTSCN",  v.VERSIONS_ENDSCN "ENDSCN", 
             v.VERSIONS_XID "XID" ,v.VERSIONS_OPERATION "OPERATION",  v.PROD_ID 
             "PROD_ID",  v.CUST_ID "CUST_ID",  v.TIME_ID "TIME_ID",  v.CHANNEL_ID 
             "CHANNEL_ID",  v.PROMO_ID "PROMO_ID",  v.QUANTITY_SOLD 
             "QUANTITY_SOLD",  v.AMOUNT_SOLD "AMOUNT_SOLD"  from SYS_MFBA_NROW r, 
             SYS.SALES versions between SCN :1 and MAXVALUE v where v.ROWID = 
             r.rid
    This consumes my resources for more than 20 minutes. what I do is, just an update 1.8 milion records (which use update is really takes little time) and validation (which kills my system).

    What is the reason for this?

    Info:
    Oracle Database 11g Enterprise Edition Release 11.2.0.1.0 - 64bit Production
    PL/SQL Release 11.2.0.1.0 - Production
    CORE    11.2.0.1.0      Production
    TNS for 64-bit Windows: Version 11.2.0.1.0 - Production
    NLSRTL Version 11.2.0.1.0 - Production

    I see that in the example of Guy Harrison the SYS_MFBA_NROW table contains a very large number of lines - and the query is forced into a loop of neste join on this table (as is your query). In your case the nested loop is a vision (and there is no sign of a current "pushed" predicate.

    If you have a very large number of rows in the table, the resulting code is bound to be slow. To check, I suggest your run the test again (from scratch) with active sql_trace or statistics_level defined at all so that you can get the rowsource for the query execution statistics and check where the time is being spent and where the volume is displayed. You will have to call this one in Oracle - if this observation is correct that FBDA is only for OLTP systems, no DSS or DW.

    Concerning
    Jonathan Lewis

  • Performance for the game Y570 problem

    Hello

    I have a Lenovo Y570 with 1 GB GT555M and Optimus technology.
    My computer is equipped with a quad core i7 2.2 Ghz and 8 GB of RAM

    When I play Battlefield 3, the gameplay is very very laggy.

    When I push the Optimus button that allows the GPU automatically decide which programs to optimize, Battlefield 3 stutters every second when I play it.
    This setting:

    When I choose the parameter indicating the GPU to save power, Battlefield 3 do not stutter, but I suffer from terrible framerates.
    This setting:

    Here is a video of my game BF3. The FPS dips 1 every second.

    http://youtu.be/jeNTLUYfNfM

    Help, please!
    My computer is new and I expect to be able to manage BF3!

    http://forums.Lenovo.com/T5/IdeaPad-Y-U-V-and-Z-series/Y570-why-do-games-run-better-off-my-battery-a...

    Everything is here...

  • System performance 'Windows' and wireless mouse problems

    I have a HP Pavilion dv7-3 with a mouse Microsoft Wireless Mouse attached model 4000.  So far it has been working well.  Now the top scroll button on the right will not work.  Down works great.  This takes place when I'm on the internet.   Brand x close tabs does not work.  The system seems to start ok but it is slow when loading startup programs.

    I have a HP Pavilion dv7-3 with a mouse Microsoft Wireless Mouse attached model 4000.  So far it has been working well.  Now the top scroll button on the right will not work.  Down works great.  This takes place when I'm on the internet.   Brand x close tabs does not work.  The system seems to start ok but it is slow when loading startup programs.

    Then. "so far"--> indicates the latter.  When he last work properly?  You can use a system restore point to return when he worked last to see if it's related software?

  • improve performance slow/windows system boot problem/screen becomes white.

    I have ccleaner and wise registry cleaner and also wise disk cleaner and norton internet security on my laptop. Firstly it will create a conflict of interest when I start windows7 base. It seems that the drive cleaner running a disk check when I start, then I deleted, because I discovered this on my list.now windows troubleshooting check the windows runs smoothly even though I personally like this wise disk cleaner program.
    HP PAVILION G6 AMD A6 VISION 3400APU with QUAD CORE and DUAL GRAPHICS - my laptop radeon. I am a novice in that Yes, you can explain issues related to my question.

    Type system information in the search box above the Start button and press ENTER. Select file, Export and give the file a name noting where it is located. Please download your disk from sky to share and post a link here.

    Please download copies of your system logs and Application of your event viewer on your sky drive and post a link here.

    To access the system log, select Start, Control Panel, administrative tools, Event Viewer, in the list on the left of the window select Windows and the system logs. Place the cursor on the system, select the Action in the Menu and record all events as and give the file a name. Do the same for the application log.

  • performance in 9.2.0 problem database

    Hi all

    Database: 9.2.0.7
    Operating system: windows 2003 wean standdard edition
    4 GB of RAM

    The ratio buffer cache / access to this server is about 83%, where it is normally was about 98% before I did some maintenance work.

    I did some maintenance work in January on this database.

    Maintenance activities include the following steps

    1. in production I deleted the old data in the production tables
    2 reorganized tablespaces, tables
    3. rebuild indexes for the tables.
    4. finally gathered statistics for tables.

    Now after this activity, the buffer hit ratio cache is very low.

    One please advice on how to increase hit ratio.

    TIA,

    ORCLDB wrote:

    Top 5 Timed Events
    ~~~~~~~~~~~~~~~~~~                                                     % Total
    Event                                               Waits    Time (s) Ela Time
    -------------------------------------------- ------------ ----------- --------
    CPU time                                                        7,029    55.87
    PX Deq: Signal ACK                                 77,056       1,950    15.50
    db file sequential read                         6,119,051       1,302    10.35
    db file scattered read                          3,544,645       1,054     8.38
    log file sync                                     127,427         551     4.38
    

    How long is the snapshot interval?
    How many CPU in the machine?
    How many users you support?
    Is your operating system 32-bit or 64-bit?
    What is an OLTP system or a data warehouse / DSS type system?

    First thoughts
    You probably have changes in execution plans because you have made a few objects smaller and denser - leading Oracle to think that tablescans and index full scans would be effective. (It is a GUESS based on the large number of 'db file scattered read' and on the assumption that this is NOT a data warehouse).

    You probably have a large amount of RAM free (your machine has 4 GB, your cache is 300 MB) and must increase the size of the cache. (That's a guess based on the fact that your reading of file db are on average less than 0.3 milliseconds are almost sure to come out to a local file system cache). Change can decrease the amount of CPU you use, because this copy between caches use CPU.

    The parallel execution should probably be stopped (based on your comments to another user on the reconstruction of index in parallel) because this can cause a lot of tablescans and index full fast scans - which are not necessarily going to use direct path reads for Oracle can do tablescans that go "series-parallel. Define suspicious clues to 'without parallel '.

    For confirmation on where the time goes - see 'SQL ordered by bed' report and look at the SQL statements execution paths two or three albums. (Note: If you set statspack to take snaps at level 6, you can usually get plans for effective implementation of the top SQL by running the srcipt $ORACLE_HOME/rdbms/admin/sqrepsql.sql)

    Concerning
    Jonathan Lewis
    http://jonathanlewis.WordPress.com
    http://www.jlcomp.demon.co.UK

    A general reminder on "Forum label / Reward Points": http://forums.oracle.com/forums/ann.jspa?annID=718

    If you mark never questions answers people decide later that it isn't worth trying to answer you because they never know if yes or no, their response has been of no use, or if you even bothered to read it.

    It is also important mark responses that you thought useful - again once it leaves other people know that you appreciate their help, but it also acts as a pointer for other people when they are researching on the same issue, also means that when you mark a bad or wrong the useful answer someone can be invited to tell you (and the rest of the forum) which is so bad or wrong on the answer that you found it useful.

  • ODI performance problem

    Hello world

    I have experience with a performance in ODI 12 c problem. One of my maps launched in more than 500 seconds while the response time for this request is only 14 seconds in environment of Toad. Step of the LOADING in the ODI process takes too long. The generated query is;

    SELECT / * + FULL (MUH_BUF) * /.

    ORGANIZATION_ID (ORG.ORGANIZATION_ID),

    (ORG. ATTRIBUTE10) MUH_KODU,.

    (MUH_BUF. TARIH FATURA_TARIHI),

    (SUM (DECODE (MUH_BUF. MIKTAR, 0, 0, MUH_BUF. NAKIT_CIRO))

    -IN SUMMARY (DECODE (MUH_BUF. MIKTAR, 0, MUH_BUF. NAKIT_CIRO *-1, 0)))

    NAKIT_CIRO,

    (CAT.) SEGMENT1) ANA_GRUP

    FROM APPS. TSA_MAGAZA_SATIS_MUH_TABLE_BUF MUH_BUF,

    APPS.HR_ALL_ORGANIZATION_UNITS ORG,

    APPS. MTL_ITEM_CATEGORIES_V CAT,

    APPS. MTL_SYSTEM_ITEMS_B S_ITEM

    WHERE MUH_BUF. INVENTORY_ITEM_ID = CAT. INVENTORY_ITEM_ID

    AND MUH_BUF.ORGANIZATION_ID = ORG.ORGANIZATION_ID

    AND MUH_BUF. FATURA_TARIHI > = add_months (sysdate,-3) -: GLOBAL.gv_MonthAgo

    AND CAT. INVENTORY_ITEM_ID = S_ITEM. INVENTORY_ITEM_ID

    AND CAT. CATEGORY_SET_ID = 1100000003

    AND CAT.ORGANIZATION_ID = 23

    AND S_ITEM.ORGANIZATION_ID = 23

    GROUP BY (ORG.ORGANIZATION_ID),

    (ORG. ATTRIBUTE10),

    (MUH_BUF. FATURA_TARIHI),

    (CAT.) SEGMENT1)

    What can be the problem.

    Tables source: Oracle

    Target Table: MSSQL

    Please help me.

    Thank you

    Hello

    Use the LKM ' LKM SQL FOR MSSQL (in BULK).

    Hope it will work, because it inserts data in bulk.

    Thank & best regards

    Shiv Kumar

  • VMDK + instant cause performance problems?

    Can think VMDK w / snapshots causing problems of performance by any chance?

    I'm on vSphere 4.1 (esxi)

    vmchr1s wrote:

    Can think VMDK w / snapshots causing problems of performance by any chance?

    I'm on vSphere 4.1 (esxi)

    Yes and no.

    Let's say you have VM - 1.  VM-1-snp (snapshot)

    If you have a database running on a virtual machine, and you create a snapshot, the data is READ in VM - 1.vmdk and WRITES to VM - 1 - snp.vmdk but databases need an AREA of IO, so go back and fourth could cause a problem.

    Otherwise performance is not normally a problem with the shots... space is the issue, and the time to commit data is the biggest problem, because your discs/SAN will take a major during the snapshot delete / validate the data.

  • What is the performance of the ODI Tweak we can do

    Hi guru,.

    What are the performance improvement we can do?


    as if a single interface takes a lot of time which parameter to check and what we can do to get better performance


    and all in all what we can do to improve the performance of ODI?

    Hello

    There is no setting of ODI which really, you can change to increase the overall performance (otherwise it would be enabled by default). So it really depends on your needs.

    Most of the work is not made by ODI itself but by your underlying DB. ODI is an ELT and not an ETL.
    While Chantal said, the best thing to do is to check the generated code and change your interface or your if necessary KM.

    For example if you think you need to run his stats, you can do something like this: http://www.business-intelligence-quotient.com/?p=1754
    You can also disable the index before the integration steps and rebuild afterwards.

    It will be useful.

    Kind regards
    JeromeFr

  • Why on: performance page does not work?

    When I try to go to about: performance, I get the message saying "Firefox can't find the file about: performance.»
    I have no problem going to any of the other: pages.

    Topic: performance page only works for me with the current build (43.0a1) Nightly, you can not use it's older versions.

    • Bug 1136927 - [meta] let slow notification of the add-on drive trains

    Please, do not comment in bug reports
    https://Bugzilla.Mozilla.org/page.cgi?id=etiquette.html

Maybe you are looking for