4.2.3/.4 data support assistant - slow when loading large files

Hello

I use the load data wizard to load csv files into an existing table. It works very well with small files up to a few thousand rows. When loading 20 k lines or more loading process becomes very slow. The table has a unique numeric column to the primary key.

The primary key is declared to the "shared components"-> logic-> "data loading tables" and is recognized as 'pk (number)' with 'case sensitve' set to 'No '.

When loading the data, these Setup executes the following query for each line:

Select 1 "Klaus". "' PD_IF_CSV_ROW ' where upper ("PK") = upper(:uk_1)

which can be found in v$ sql view during loading.

It makes the process of slow loading because of the superior function, no index can be used.

It seems that the setting of "case sensitive" is not rated.

Removing the numeric index for the key primary and with the help of a function based index do not help.

Explain plan shows an implicit conversion "to_char":

UPPER (TO_CHAR (PK) = UPPER(:UK_1)

It is missing in the request, but perhaps that it is necessary for the function based index to work.

Please provide a solution or workaround to load data Wizard work with large files in a reasonable time.

Best regards

Klaus

You must have the correspondence of PK to be "exactly - case-sensitive" (or something like that)

In addition, I was already on the slowness with Oracle Support when dealing with important content.

They are aware of the problem.  Only around is known to break up the data into smaller segments.

(I'll have to track down the correct ID for reference...)

My observation:

APEX data loader makes a slow-by-slow transformation of the data instead of treatment in bulk.

You will need to break up the data, or to build your own data loader.

Thank you

MK

Tags: Database

Similar Questions

  • HP 2000 laptop: HP Support Assistant does not load

    When you try to open HP Support Assistant, I get a pop-up stating "HPSF.exe has stopped working" and "Try Again" selection does not resolve the situation.

    Hello

    Try to reinstall the original version of the HPSA came with the laptop using Recovery Manager - how to use Recovery Manager to reinstall the drivers and the software is detailed in the document at the link below.

    Recovery Manager - Windows 8.

    After reinstalling, restart the laptop.

    Kind regards

    DP - K

  • I'm runinng Windows XP Home Edition 5.1 Service Pack 3 but my computer is very slow when loading files could you tell me about the software to speed things up please

    My computer is very slow runinng when I'm checking my Email and sorting out when I delete the emails I don't want it seems to take more than five minutes to remove as it is very slow to load web pages from the Internet

    HI Bob,

    Unless you use MSE and think the problem is caused by malware (which is possible, but not very likely given the much more likely reasons - however, if this is the case, after return and we will be happy to provide instructions on how to clean your system and check that this has been done correctly and completely) please repost it here for help on this issue: http://answers.microsoft.com/en-us/windows/forum/windows_xp-performance?page=1&tab=all&tm=1300700638376 where experts in the field are better qualified to help you.

    Good luck!

  • Explorer is slow when you open files 'Application '.

    My explorer is extremely slow when opening files 'application '. The programs I have on my Alienware M15X that could cause the problem are Uniblue 2010, Ccleaner and Kaspersky Internet Security 2010. Please someone help me.

    Nevermind SpiritX, uninstallation of Kaspersky Internet Security 2010 fixed the problem. Love :D

  • Handful of sequence data contains incorrect values when loading the saved project

    Hi people!


    I ran into a problem where my values of sequence data are not correct when you open a project with an instance of my effect plugin.

    The values look good if I manually inspect when they are flattened and written in a fine when handle memory and restore AE sends PF_Cmd_SEQUENCE_RESETUP once the backup is complete.  But when I open / load the saved project, the values are not correct.  In other words, my logic flattening/unflattening works within the same session, but during the loading of a saved project, the flattened data is incomplete or has bad values.

    I write several objects to the handful of flat sequence data, and I was wondering if this could be the cause.

    The flattened sequence data manage memory looks like this:

    [[type struct A] [type struct b] [b] of type struct] [struct type b] <.. .arbitrary number of struct type BS... >]

    NB of struct type B varies, so when I ask AE for a handle of memory, I have this:

    size_t flatSequenceDataSize = sizeof(structTypeA) + (sizeof(structTypeB)* numberOfBStructsNeeded);
    PF_Handle flat_seq_dataH = suites.HandleSuite1()->host_new_handle(flatSequenceDataSize);
    
    
    

    Then, to write the data to the handle:

    structTypeA myDataA = <... populate struct values ...>
    std::vector<structTypeB> allStructB_V;
    <... populate vector ...>
    
    void *flat_seq_dataP = suites.HandleSuite1()->host_lock_handle(flat_seq_dataH);
    
    structTypeA *structA_P = reinterpret_cast<structTypeA*>(flat_seq_dataP);
    memcpy(flat_seq_dataP, &myDataA, sizeof(structTypeA));
    
    structTypeB *structB_P = reinterpret_cast<structTypeB*>(flat_seq_dataP);
    
    //offset pointer by the size of the first struct in the handle
    structB_P += sizeof(structTypeA);
    
    for (A_long vectorIndex=0; vectorIndex < allStructB_V.size(); vectorIndex++) {
        *structB_P = allStructB_V.at(vectorIndex);
        structB_P+= sizeof(structTypeB);
    }
    
    out_data->sequence_data = flat_seq_dataH;
    suites.HandleSuite1()->host_unlock_handle(flat_seq_dataH);
    
    
    

    When I access the handful of sequence data loading stage, the first struct in the flattened handle has correct values, but all following structs have false values.  I check if the handle is always the right size (I save the size of the handle inside the first structure) and it is indeed the correct size.  I wonder if AE doesn't like how I write from the structB to the handle.

    I'm doing something wrong here?  Is there a better way to store data of arbitrary sizes?

    Thanks for your help!

    -Andy

    Ah, I missed actually a significant error in your pointer arithmetic! You're actually in the land of UB ("undefined behavior") with your code!

    You add byte offsets to a pointer type, which is doomed to failure if you don't know what you're doing.

    If you have

    structTypeB * structB_P = reinterpret_cast(flat_seq_dataP);

    and do you

    structB_P += sizeof (structTypeA);

    most of compiler that turn into something like this:

    structB_P = (structTypeB *) ((unsigned char*) + sizeof (structTypeA) * sizeof (structTypeB));

    Wrong in your case (in most cases actually).

    Or more simple put:

    If you have a pointer

    structTypeB * structB_P =...

    and you do:

    structB_P += 3;

    It actually means

    structB_P = strucB_P + 3 * sizeof (structTypeB);

    already!

    Try running your pointer to an unsigned char * or another type of 1 byte basis and then make the increment, and then recast.

    Here's a site with more information on this:

    http://StackOverflow.com/questions/15934111/portable-and-safe-way-to-add-byte-offset-to-an y-pointer

    It could then look like this (on the top of my head, did not check!):

    void * flat_seq_dataP = suites. HandleSuite1()-> host_lock_handle (flat_seq_dataH);

    structTypeA * structA_P = reinterpret_cast(flat_seq_dataP);

    memcpy (myDataA, sizeof (structTypeA) & flat_seq_dataP);

    structTypeB * structB_P = reinterpret_cast(reinterpret_cast(flat_seq_dataP) + sizeof (structTypeA));

    memcpy (structB_P, allStructB_V.data (), sizeof (structTypeB) * allStructB_V.size ());

    out_data-> sequence_data = flat_seq_dataH;

    Suites. HandleSuite1()-> host_unlock_handle (flat_seq_dataH);

  • HP support Assistant does not load "an error has occurred."

    All the fields are blank, I tried to uninstall, I get an error. Downloaded and reinstalled it, no change

    Hello

    Try the Microsoft 'Fixit' on the link below to see if you can uninstall HPSA correctly before reinstalling.

    http://support.Microsoft.com/mats/Program_Install_and_Uninstall

    Kind regards

    DP - K

  • How to find the question after hp support assistant opening when the icon indicates the red exclamation point?

    Hi guys,.

    A new pavilion g6 and sometimes get the red exclamation on the HP SA but when I open the screen of the wizard how to find the issue which marked the icon?

    The Assistant has just opened, and I see the screen normal but not extra "Pavilion" to tell me what needs attention?

    Is this normal?

    See you soon!

    Ian

    screenshot of open SA HP...

    Hello again, TheHandyCrowd, and ionamartin123.

    Made this suggestion solves your problems?  I was curious about the result.

    I hope that you are having a great day!

  • 0x8007000d the data is not valid when which a file name.

    I just got a new computer with Windows 7.  I transferred all my music to the new machine and have incountered a couple problems.  I use a program called winamp to play my music and that works very well; However windows media player does not recognize more than half of music tags that winamp is to see very well.  When I go into the file & try to update the information by adding an artist or track # I get the following error: 0x8007000d the data is not valid.  Also when I run Windows media player it sucks to the top of my processor speed b/c its continualy "downloading information for an unknown artist" is a brand new macine w / very few additional programs. I have a deck of cards, Winamp, and Windows.  I'm always EMU does not download toolbars.  Music is a big part of my computer, and it becomes very frustrating.  I don't want to install i-tunes!  Help

    Hi Kishvens,

    Welcome to the Microsoft Answers Community Forum site!

    In order to solve your problem, please let us know what are the types of file, with which you have a problem? If it's MP3 or any other format

    There are some third-party tools that will help you recreate the corrupt tags.

    For more information, suggest you check the mentioned below for relationships, where the customer's problem solved.

    http://social.technet.Microsoft.com/forums/en-us/w7itpromedia/thread/4b362563-88d8-4814-9ae3-f98e21375af2

    http://social.technet.Microsoft.com/forums/en-IE/w7itproinstall/thread/fd434d22-8765-44DB-8B17-2257a3619255

    I hope this helps solve your problem!

    Thank you best regards &,.

    Calogero - Microsoft technical support.
    Visit our Microsoft answers feedback Forum
    http://social.answers.Microsoft.com/forums/en-us/answersfeedback/threads/ and tell us what you think

  • listener very slow when listener.log file reach the size 4G

    client cannot connect to the instance, and has an error:
    ----------------------------------------------
    AMT-12560: TNS: Protocol adapter error
    AMT-00530: Protocol adapter error
    Windows 64-bit error: 53: unknown error
    TNS-12518: TNS: listener could not hand off client connection
    AMT-12571: TNS: packet writer failure
    AMT-12560: TNS: Protocol adapter error
    AMT-00530: Protocol adapter error
    Windows 64-bit error: 54: unknown error

    I restart the receiver, but it is very slow to boot completely.
    I found that the listener.log file is size 4G, when I delete this file and restart receiver, the listener is normal.

    If the log file has a 4G limited by oracle?

    Version:
    -------------------------------------------------------------------
    Oracle Database 11 g Enterprise Edition Release 11.2.0.1.0 - 64 bit Production
    PL/SQL Release 11.2.0.1.0 - Production
    CORE 11.2.0.1.0 Production
    AMT for 64-bit Windows: Version 11.2.0.1.0 - Production
    NLSRTL Version 11.2.0.1.0 - Production

    Bug 9497965 - Win: listener startup fails Due to listener.log size is greater than 4 GB [9497965.8 ID]

    better in time you should clear the logs and keep it less than 4 GB.

    Thank you
    Christian Christmas Pal Singh

  • HP Support Assistant has stopped working

    HP ENVY Phoenix h9 - 1420t CTO desktop PC

    8.1 Windows Pro w/Media Center - 64 bit

    For some unknown reason, HP Support Assistant has stopped working. I noticed that the large taskbar icon had disappeared.

    I tried to run the program just out of curiosity. "HP Support Assistant has stopped working. A problem caused the blocking of the program works properly... "etc. It is reproducible. The program does not start.

    So, I tried to uninstall in Control Panel of. It seems to start to uninstall, but then I get an error message. "Error 1316 a network error occurred trying to read the file C:\windows\Installer\HP support Assistant.msi" when I click "OK" it cancels. This is also reproducible.

    I tried to download the software again from HP: sp64126.exe I accept the license agreement and moving forward. I get a message that files already exist and I want to overwrite all or not. Matter of INo I choose, nothing happens. The installation window simply disappears and I'm at square one.

    Windows is fully updated. I use Norton Intertent security 21 - fully implemented to date.

    I solved this on my own. HP has a Recovery Manager installed on my system [search---> Recovery Manager] and aid that allowed me to reinstall just this software from my hard drive recovery partition. Very cool!

  • get the last error of coming to the g4 pavilion 1210 hp support Assistant to laptop

    1. product name and number of :

    Pavilion g4 laptop 1210se

    2. the installed operating system:

    Windows 7 home basic 64-bit


    3. error message:

    (get the latest hp support assistant) the error appeared in the hp support assistant

    When I click and install the update it doesn't effect in case of error.

    4. all changes made to your system until the problem occurred:

    None


     

    Hello

    Try the following.

    Unless you still have the installer, download the latest version of HP Support Assistant from the page on the link below - download links are to the bottom of the page - and Save the installer to your download folder.

    http://h18021.www1.HP.com/helpandsupport/HP-support-Assistant.html

    Then, if you do not have an extraction utility installed, download and install 7-Zip.  Please note that If you have a 64-bit installation, download and install the Installer x 64 64-bit .msi on the link below.

    http://www.7-zip.org/

    Then, right click on the HPSA installer you download earlier, select Extract 7 - Zip, select the files, and then click Ok.  The newly extracted folder, right-click on UninstallHPTCA and select "Run as Administrator" - you may well see no progress of this attempt uninstalling, then leave the laptop at idle for a good 10 minutes before restarting it.

    When Windows has completely recharged, run Microsoft 'Fixit' on the link below again before trying to install the new version of HPSA...

    http://support.Microsoft.com/mats/Program_Install_and_Uninstall

    Kind regards

    DP - K

  • How can I uninstall and reinstall HP Support Assistant?

    I don't know if this software is installed in my computer.  There is a message telling me that there is a problem with HP Support Assistant, but when I click it says something like that is not available (the message or I don't know what /).  In addition, every time I try to check the levels an message telling me that HPBC is unable to launch.

    Any suggestions for fixes?  Thank you.

    Download and run the HP software Cleanup utility

    http://h10025.www1.HP.com/ewfrf/wc/softwareDownloadIndex?softwareitem=OJ-11696-6&LC=en

    Download your support asst here:

    http://h18021.www1.HP.com/helpandsupport/HP-support-Assistant.html

  • support assistant saying 'important necessary action' with the Red exclaimation mark, but none found

    Hello.  I have a laptop G6 and when I turn it on I get a red exclaimation mark on the icon support assistant and when a hover above him with cursor, it says 'important necessary action. "  When I go in, there no update or advice or something that I see for me to do.  Even if I restart of/off voltage, the Red rest mark.  any help would be appreciated as this is my OCD in!  See you soon.

    Hello gtx007

    Thank you for having responded with the necessary information. I would like you to uninstall, and then reinstall the HP Support Assistant software by following the steps I have described below:

    Step 1. Open programs and features by clicking on the button start

    Step 2. Click on Control Panel

    Step 3. Click on programs

    Step 4. Click on programs and features
    Step 5. Select HP Support Assistant

    Step 6. Click on uninstall

    Step 7. Restart your computer

    Step 8. Download and install the latest version of HP Support Assistant

    This should solve your problem and allow the HP Support Assistant to function correctly on your system. I want to thank you for posting your question here on the HP Forums. Have a great weekend!

  • How to update HP support assistant in Vista when he says for windows 7 only

    I have some errors that the system can be solved if I upgrade the HP Support Assistant.  When I click on the link for the upgrade, download instructions that it is for Windows 7 only.  I have the camera software on my system which does not work on 7 and that is why I have not changed.  Is there another way to update from HP on Vista

    Hello

    you get the updates from HP and HP's HP program upgrades

    HP support

    http://welcome.HP.com/country/us/en/contact_us.html

    or try the HP support forums

    http://h30434.www3.HP.com/

    and here is the link for the HP drivers and support

    http://welcome.HP.com/country/us/en/support.html

    and for any software camera problems go to the camera manufacturer's website and search the device drivers and the software of the camera

  • DIAdem v11.1 SEEN very slow to load pan and zoom 2D graphics axis

    As for the user KJ2, I find DIAdem version 2011 very slow when loading the data in the display.

    I have two laptops, a DIAdem 2010 operating and the other the new 2011. IAM loading the same PDM file into two versions.

    The 2010 takes more time initially to load the data in the browser window, but it is almost instant when zoom and pan in the display window.

    Load the file instantly in the browser of the 2011, but then takes an age to zoom and pan, which is very frustrating when the analysis of the data.

    I can improve performance at the 2010 level if I load the data with an interval of small applied reduction (factor 2) - once again, it takes much more time to load in the browser window, but is now usable in the view window.

    The only problem now is that all channels are renamed with the Appendix "sample".

    I guess that's a result of the new feature 'optimised loading data' which I guess is only load the data when I need IE when zooming and panning in the display!

    Help please, before I resort to re - install 2010!

    Karoline

    Hello Albert,.

    It is a relatively easy solution:

    In the BROWSER, go to the menu "settings":

    In the dialog box that is displayed, change the setting of data "always load in bulk.

    Alternatively, you can also change this in the dialogue box "parameters: compatibility", but I don't know what is the difference between these two methods.

    Hope that helps, no need to return to the 2010 version after these changes. Oh and don't forget to save your configuration file after making the changes to make them permanent!

    Otmar

Maybe you are looking for