Failed to 150 000 lines extracted from "xlsx" SQL query results

Environment:

SQL * Developer 3.1.07.42 on Windows XP SP3
Oracle 11.2.0.3 EE on Solaris 10.5

I ran a query in a spreadsheet window and the first page of results came back in 10 seconds, whoo hooo!

I right click on the first column of the first row and selected 'Rows Count' and back 527 563 after thinking a bit.

I clicked 'Export', selected a box for "Query worksheet name" "xlsx", uncontrolled size and traveled to specify the output file directory (my local C: drive) and the name of the file. I clicked on "Next" and then on "Finish".

I watch the meter of the line at the bottom right of the window and it went very quickly until he hit about 150 000 lines and then it started to slow down. It got slower and slower and slower and slower, and you get the picture, and finally, I killed the process when it took more than 15 seconds from 156 to 156 250 245.

Why would it be?

Additional information:

I have the same exact query is represented and exported the same lines 527 563 using the "xls" instead of "xlsx" format and the process has proceeded all the way to the end very quickly and successfully completed in just a few minutes. The worksheet resulting contained 8 eight worksheets since it could only put 65536 lines on each worksheet. This was acceptable to the user who just merged the data manually.

There are some issues with the help of "xlsx" format of output as opposed to simply use it as input format?

Is SQL * Developer trying to create a spreadsheet with the same number of rows as the data up to the max in Excel 2010 (over 527 563)?

Thanks a lot for all shed light on this issue. If I omitted no details important please let me know and I'll try to include them.

-gary

Hi gary,.

You may have seen one or more threads as follows on the question of fees increased memory overhead for the formats of Excel:
Re: Developer Sql 3.1 - export a set of results in xls generates and empty the file

Basically, Developer SQL uses a third-party provider API to read and write these Excel formats. There are separate readers and trainers for each of the forms xls and xlsx.

There is a new version of the API that supports streaming of xlsx workbooks. Basically, he made a much lower footprint bearing in mind that the lines which are in a sliding window, while that older, without flow version gives access to all lines in the document. The programmer can define the size of this window. In my view, that the most recent version of the API was not available or is not stable during our cycle 3.1 development. Perhaps a future version of SQL Developer can use it.

Kind regards
Gary
SQL development team

Tags: Database

Similar Questions

  • How to get the line number in the line itself in the Sql query?

    Hello
    I pick up some lines of a sql query. Is it possible to get line number in each line while all lines are read?

    Like this:

    RowNum data1 data2
    1 abc era
    2 NBH ioi

    Yes.

    ROWNUM

    http://download.Oracle.com/docs/CD/E11882_01/server.112/e17118/pseudocolumns009.htm#SQLRF00255

    select rownum, data1, data2
    from yourtable;
    
  • How to bind the user interface component to a display object that is created from a SQL query

    I use JDeveloper 11.1.1.2.

    I created a method in my ApplicationModule to create a dynamic ViewObject instance based on a 'voCode"passed in:

    public loadVO (String voCode) {} ViewObject

    ViewObject viewObject = findViewObject (voCode);
    If (viewObject == null) {}
    viewObject = createViewObject (programCode);
    }
    return viewObject.
    }

    I created a Client interface for this method and updated the control data of the ApplicationModule.

    The "Oracle JDeveloper 11g Handbook", I should be able to create a link from the tree and an executable methodIterator to the method of "loadVO" through the control of AOS data.

    I tried to manually add the binding to the definition of the page my page jspx, I like to see if I can replace an existing binding with this new binding.
    I was not able to add the link under "tree to create binding" 'Root Data Source' both 'Tree level rules' must be specified.
    I was able to specify the root 'Data Source' to point to the "loadVO" and the corresponding parameter, but not able to add a rule.
    When I clicked on the icon "+" to add the rule, anything that allowed me to clarify the rule (if I know which rule I should add).

    How can I bind the module of the application 'loadVO' method while it is exposed in the data control to provide data to a UI like PivotTable component?

    On the other hand, I was able to create the "methodIterator" first for the method 'loadVO' AM but I wasn't able to create a tree link to refer to the "methodIterator".
    Is it possible to call the method loadVO with the value of specific setting via the "methodIterator" of a bean method?

    Published by: pyin_amec on January 25, 2010 15:57

    I've corrected the subject line and change my question to better reflect the problem I tried to solve.

    Published by: pyin_amec on January 26, 2010 07:41

    Hello
    It worked for me... I created an inputtext area where I can enter a query and run...
    It could be that useful...

    AM Impl

         public void createVoWithQuery( String pQuery )
         {
    
              ViewObjectImpl vo = null;
              if( findViewObject( "DemoVo" ) != null )
                   findViewObject( "DemoVo" ).remove();
    
              vo = ( ViewObjectImpl )createViewObjectFromQueryStmt( "DemoVo", pQuery );
              //  vo.setKeyAttributeDefs( new int[]{0} );
              vo.executeQuery();
         }
    
         @Override
         protected void prepareSession( Session session )
         {
              super.prepareSession( session );
              if( findViewObject( "DemoVo" ) == null )
                   createViewObjectFromQueryStmt( "DemoVo", "Select 1 from dual" );
         }
    

    Page Def

    
        
          
        
        
      
      
        
          
    
          
        
        
          
        
        
          
            
          
        
      
    

    page

    
              
                
                  
                    
                      
                    
                  
                
              
              
              
                
                  
                    
                  
                  
                
              
            
    
  • Body of function from PL/SQL query SQL - problem with where Cluase return

    Hi all
    I have problem with sub PL/SQL. Where clause does not filter the values even when I change the value: P7_INVESTIGATOR. I have marked with an asterisk for where clause where I want the values to filtered.


    DECLARE
    v_sql varchar2 (5000);
    v_inv VARCHAR2 (100);

    Start
    v_inv: = UPPER(:P7_INVESTIGATOR);

    v_sql: = ' select TBLCASES. INVESTIGATOR as an INVESTIGATOR,';
    v_sql: = v_sql | "TBLCASES. CASENUMBER as CASENUMBER,';
    v_sql: = v_sql | "TBLCASES. OPENDATE as OPENDATE,';
    v_sql: = v_sql | "TBLCASES. ESTCOMPLETE as DATE_CIBLE,';
    v_sql: = v_sql | "TBLCASES. STATUS of STATUS ';
    v_sql: = v_sql | "TBLCASES. Case CODE case CODE as,';
    v_sql: = V_sql | "TBLCASES. FAIR_HOTLINE as FAIRHotline,';
    v_sql: = v_sql | "TBLCASES. NYSIG as NYSIGCase,';
    v_sql: = v_sql | "TBLCASES. The REGION';
    v_sql: = v_sql | "TBLCASES. PROGAREA as PROGArea ';
    v_sql: = v_sql | ' from TBLCASES where 1 = 1';
    **************************************************************
    If v_inv <>null then
    v_sql
    : = v_sql | "and UPPER (trim (tblcases.investigator)) = UPPER (trim (v_inv))';
    END IF;
    ***************************************************************
    v_sql: = v_sql | "order by tblcases.investigator";
    Return v_sql;
    end;


    Thank you

    wrote:
    Or it is possible to write it this way:

    if v_inv is not null then
    v_sql := v_sql ||'  and UPPER(trim(tblcases.investigator)) = UPPER(trim(:P7_INVESTIGATOR))';
    END IF ;
    

    In this case we will use bind variables and we all know that it is very important.

    Lev

    Of cause, it is the best option. and I strongly suggest the OP to use.
    But it depends on how the sql is used later.
    Without knowing that, we cannot be sure if the item is available here.

  • I would like to delete empty lines and spaces of my query results?

    11 GR 2

    -----------------------------------------------------

    My query:

    Select REGEXP_REPLACE (dbms_metadata.get_ddl ('PROCEDURE', 'HEL_'), ('user1...') ", 1, 0, 'i') of double

    -------------------------------------

    result:

    CREATE OR REPLACE PROCEDURE "HEL_"
    as

    begin

      dbms_output
    .put_line('Hello!');

    end;


    ------------------------------


    expected result:

    CREATE OR REPLACE PROCEDURE "HEL_"
    as
    begin
    dbms_output
    .put_line('Hello!');
    end;




    Hello

    I don't think that there is a way to make changes in the same regular expression.  You can do a REPLACE separate to get rid of 'the USER '. nesting into one another, like this:

    SELECT REGEXP_REPLACE (REPLACE (dbms_metadata.get_ddl ('PROCÉDURE', 'HEL_')

    "' USER1'."

    )

    , '^\s+'

    NULL

    1

    0

    , 'm'

    ) AS less_whitespace

    OF the double

    ;

  • gc_w01_enu_nb.exe extracted from 100%, but Setup fails instantly in winxp pro

    gc_w01_enu_nb.exe extracted from 100%, but Setup fails instantly in winxp pro

    I try to install the full feature driver for my PSC 1315xi on two WinXP Pro PC.

    One worked perfectly.

    On the second, when I run the exe download, I get the message 'Extraction', but when he goes up to 100%, never open the setuup window.  And no error message is displayed.  I searched and found a log file which was produced.  It includes the following:

    GetValueByLang (f-> c_str(), _T (Version), _T (LanguagesInthisCD) failed "
    System LangID = 1033.  mapped to ENU
    # The system language is ENU, but is not on our CD!
    # We couldn't understand a language to use and return FALSE from CICECmdLine::GetLanguage()!
    # GetValueByLang (f-> c_str(), _T (Version), _T (LanguagesInthisCD) failed "
    Installer returned 1603

    Any help would be appreciated.

    I think I have solved this problem.

    I have a PC Windows XP Pro (SP3) who has been affected by this problem.

    Immediately after that the window of 'extraction' went to 100% and closed, nothing happened.  The windows install/never display software.

    Whenever I tried it creates a log file that started with this:

    "Parsed command line: «.\Setup.exe".

    Using datfile: C:\DOCUME~1\xxxxx\LOCALS~1\Temp\7zS1293\autorun.inf

    # GetValueByLang (f-> c_str(), _T (Version), _T (LanguagesInthisCD) failed "

    System LangID = 1033.  mapped to ENU

    # The system language is ENU, but is not on our CD!

    There was other error messages after that, but they all come from lines 3 and 5.

    Something she prevented the installation program to recognize the language ENU files ARE present in this download.

    Comparing two PCs, a problem, and one that works perfectly, I saw that one who was not was AutoRun disabled through a registry setting.  I temporarily deleted this registry on the PC that wasn't and Setup launched and ran like he was supposed to.  Here are the first of this log from the same PC, a few minutes later, where the only difference was that I had removed the registry setting criminalized:

    "Parsed command line: «.\Setup.exe".

    Using datfile: C:\DOCUME~1\xxxxx\LOCALS~1\Temp\7zS1293\autorun.inf

    System LangID = 1033.  mapped to ENU

    We use the system of language = FRA, which is located on our CD!

    As you can see, the message "(LanguagesInthisCD) failed" (line 3) disappeared, and the line 5 (now line 4) shows that it has to recognize that the language ENU installation files are present.

    So if you encounter this problem, and you are comfortable with the system registry, here is how I got it to work on my PC:

    Start regedit
    Navigate to the bottom of this tree
    -HKEY_LOCAL_MACHINE
    -SOFTWARE
    -Microsoft
    -Windows NT
    -CurrentVersion
    -IniFileMapping
    Below, find out if there is a key named "Autorun.inf".
    On my PC (the one with this problem) the value of this key has been "@SYS: nexistepas".
    If your registry database also has this, it may be the cause of your problem.
    In the left pane of regedit, do a right click on Autorun.inf and select "Rename" from the context menu.
    Change the name to something like "Autorun.inf.hold".
    Close regedit
    At this point, I restarted my PC, but I don't know if it is really necessary.
    I ran the downloaded driver file.  It extracted, and the Installer started out as it was supposed to.

    When it was done, I returned in regedit and renamed "Autorun.inf.hold" to "Autorun.inf".

    It is extremely frustrating for me, and (if you need it), I hope that this solution works for you.

  • I would use Yuanti SC police for my web development project. However, my developer is not able to use the file .ttc I extracted from the library of fonts, and .ttf, .otf .woff formats not available anywhere on the web.

    I would use Yuanti SC police for my web development project. However, my developer is not able to use the file .ttc I extracted from the library of fonts, and .ttf, .otf .woff formats not available anywhere on the web. Please, let me know how can I use this font for my project.

    Thank you

    Anton

    Unless the site you develop is for the Asian market, I don't know why you want to use that particular font. The Basic, standard and digital alphabet punctuation glyphs has sans serif, Roman characters, but the rest is thousands of Kanji characters. While you can use the font .ttf and .otf and web fonts, it would be very unusual to use one so great. Pages should load quickly and 78 MB, with a value of faces to download for those who have connections slow Internet is not fast.

    I would take a different font without serifs. There are literally thousands who look identical or virtually identical to Yuanti.

    131 free and high quality without font serif to choose here. I'm sure you can find a desired.

  • Failed to retrieve quotes and news from investor to my 99 Silver plan

    Failed to retrieve quotes and news from investor in my 99 Silver plan

    Hello

    Could be a temporary problem.

    Check in the Microsoft Money Forum.

    Microsoft Money - Forum
    http://social.Microsoft.com/forums/en/money/threads

    Microsoft Money Solution Center - suggests alternatives
    http://support.Microsoft.com/mny

    What is Microsoft Money Plus sunset
    http://support.Microsoft.com/kb/2118008

    BING - microsoft money replacement
    http://www.bing.com/search?q=Microsoft+Money+replacement&go=&QS=n&SK=&SC=7-27&form=QBLH

    Google - microsoft money replacement
    http://www.google.com/#sclient=psy-ab&hl=en&source=hp&q=microsoft+money+replacement&pbx=1&oq=microsoft+money+replacement&aq=f&aqi=g4&aql=&gs_sm=e&gs_upl=9978l11972l2l12926l12l1l0l0l0l0l467l467l4-1l1l0&bav=on.2,or.r_gc.r_pw.,cf.osb&fp=dcc84c4c7dd2e143&biw=1024&bih=681

    I hope this helps.

    Rob Brown - Microsoft MVP<- profile="" -="" windows="" expert="" -="" consumer="" :="" bicycle=""><- mark="" twain="" said="" it="">

  • Why my machine instead of back stop running? FATAL shutdwn: WUAutoUpdateAtShutdown failed, hr = 8024A 000

    Manually, I ran windows updates on my Remote Server 2003 computer last week and said to reboot later.  The server did not return and my production machine declined until someone on the spot could turn it back on the next day.  The error message windows journal is the only thing I found which indicates that there is any problem.  He said no entries in the event where the newspapers after the machine was rebooting until it was manually in reverse.

    FATAL shutdwn: WUAutoUpdateAtShutdown failed, hr = 8024A 000

    Why my server is stopped when I told him explicitly to restart?

    Hello Server2003_Admin,

    Thanks for your post.  Please ask your question in the Windows Server on TechNet forums as they manage all the server related issues.

    See you soon

  • When I try to extract from a CD, it begins to tear, but after about 20%, it is up to the error, but no code error

    original title: Help with Media Player

    I have problems with the Media Player.  When I try to extract from a CD, it begins to tear, but after about 20%, it is up to the error, but no code error.  Is it necessary to habve a network.  I have one and am wondering if I need or is it why extraction will not work?  I don't know where the network came, but if I need it how to remove it

    Hi Nanabarb,

    1. you have made no changes to the computer before the broadcast took place?
    2. What is the format of the files you are trying to extract?
    3. do you get an error message?
    4. the problem occurs with any particular drive?

    I suggest you to see the following links to make sure that the check-out settings correct. You don't have to be on the network.

    Open the troubleshooting Windows Media Player settings Troubleshooter
    http://Windows.Microsoft.com/en-us/Windows7/open-the-Windows-Media-Player-settings-Troubleshooter

    Extract music from a CD
    http://Windows.Microsoft.com/en-us/Windows-Vista/rip-music-from-a-CD

    Rip music: frequently asked questions
    http://Windows.Microsoft.com/en-us/Windows-Vista/rip-music-frequently-asked-questions

  • 5 Lightroom sometimes fails to load EXIF GPS data from .jpg files

    Until I Lightroom, I used geoSetter to add GPS data to my .jpg files. Most of them have loaded up in LR without problem, but for some of them, Lightroom could not import the GPS data. I used to compare GPS data in the loaded files OK and those who have not noticed that some of the problem files do not have exiftool: GPS, GPS Time Stamp, dater GPS map data. I used exiftool to change these in the file, Lightroom still not managed to load GPS data.  Anyone has an idea why Lightroom 5 sometimes fails to load EXIF GPS data from .jpg file

    = P3207532.jpg - data from GPS not imported into Lightroom

    ID of the GPS Version 2.2.0.0

    GPS Latitude Ref North

    GPS Longitude Ref is

    REF Altitude GPS altitude

    Time GPS 2015:03:20 02:18:36Z

    GPS Latitude 20 deg 54' 41.68 '' N

    GPS Longitude 107 deg 0' 5.47 "E

    GPS Position 20 deg 54' 41.68 '' N, 107 deg 0' 5.47 "E

    = P3207533. JPG - Imported data GPS OK in Lightroom

    ID of the GPS Version 2.2.0.0

    GPS timestamp 02:22:26

    GPS map Datum WGS-84

    GPS Date Stamp 2015:03:20

    Time GPS 2015:03:20 02:22:26Z

    GPS Latitude 20 deg 54' 43,41 "N

    GPS Latitude Ref North

    GPS Longitude 107 deg 1 9.10 ' E

    GPS Longitude Ref is

    GPS Position 20 deg 54' 43,41 "N, 107 deg 1 9.10 ' E

    = P3207532.edited.jpg - data from GPS not imported into Lightroom

    ID of the GPS Version 2.2.0.0

    GPS Latitude Ref North

    GPS Longitude Ref is

    REF Altitude GPS altitude

    GPS timestamp 02:22:26

    GPS map Datum WGS-84

    GPS Date Stamp 2015:03:20

    Time GPS 2015:03:20 02:22:26Z

    GPS Latitude 20 deg 54' 41.68 '' N

    GPS Longitude 107 deg 0' 5.47 "E

    GPS Position 20 deg 54' 41.68 '' N, 107 deg 0' 5.47 "E

    The problem with P3207532.jpg is that it contains two sets of GPS, a values in the section of EXIF metadata in the XMP metadata section:

    $ exiftool -a -G P3207532.jpg | grep -i gps
    [EXIF]          GPS Version ID                  : 2.2.0.0
    [EXIF]          GPS Latitude Ref                : North
    [EXIF]          GPS Latitude                    : 20 deg 54' 41.68"
    [EXIF]          GPS Longitude Ref              : East
    [EXIF]          GPS Longitude                  : 107 deg 0' 5.47"
    [EXIF]          GPS Altitude Ref                : Above Sea Level
    [EXIF]          GPS Time Stamp                  : 02:22:26
    [EXIF]          GPS Map Datum                  : WGS-84
    [EXIF]          GPS Date Stamp                  : 2015:03:20
    [XMP]          GPS Date/Time                  : 2015:03:20 02:18:36Z
    [XMP]          GPS Version ID                  : 2.2.0.0
    

    But the XMP section contains an incomplete set GPS fields. Note that XMP:GPSDateTime specifies a time other than EXIF:GPSTimeStamp.

    I don't know which of your programs may have created these XMP values false, incomplete, but they confused LR.  According to the specifications of the Working Group of the metadata, which accepted LR, LR, choose the EXIF GPS values and false XMP values should not confuse it. But LR is preferring the XMP values and then conclude it is not all the GPS coordinates.

    You can work around this bug in LR by doing:

    ExifTool - xmp: gpsdatetime = - xmp: gpsversionid = file

  • CFGFWK-60850: the Test failed! CFGFWK-60853: A connection to the database, but no lines have been returned to the examination of the SQL query.

    Hi all..

    It's SOA 11.1.1.7... I created the schema and storage via RCU but when I try to configure JDBS schema components... his throw this error:

    CFGFWK-60850: the Test failed!

    CFGFWK-60853: A connection to the database, but no lines have been returned to the examination of the SQL query.

    I created 3 users of UCR and who were all successful, because I have no error... of these three alone is managed in the configuration tree SOA...

    No idea why like that...

    Thank you

    Aerts

    This that I solved it by installing EMP 11.1.2.2 with UCR and SOA 11.1.1.6...

  • What is the right way to commit 100,000 lines?

    Hi guys and girls,

    With the help of JDev 11.1.2.3.0.

    I have 10 000 ranks of the master, gave each of them runs in 9 different algorithms, 90 000 detail lines.  I now need to commit the 100,000 (10 000 masters & 90 000 retail) lines to my database.  What is the best way to accomplish this feat?  I am open to suggestions and ideas.  I'm not married to a particular approach, any strategy and have little experience running such a large DataSet.

    Currently, I iterate through the lines view object 10 000 in my application and for each line module, apply a Prediction algorithm, whose results are inserted into an object of the detail view.  The main line of vo is updated with a reference for the best results in detail, and then all have been committed through getDbTransaction.commit ();

    Is there a way to say, commit 10 000 lines, let the database do its thing and once again the calculations?  Once the database did commit, commit an another 10,000.  In this way the module of the application and the database work in parallel rather than one waiting on the other.

    Thoughts?

    Thank you

    Will be

    It looks like that there. Check the Advanced Techniques of object entity - 11 g Release 1 (11.1.1.7.0)

    As far as I know, there is no parallel work (adf and db). What you can do is to use the PL/SQL to insert the data and calculations on the side of the db. This can be faster than to browse all lines in the adf.

    Timo

  • I use LR5.7 based on Windows 7 and got a few pictures 150 000 in a catalugue. Could import, export and rendering speed be increased, if I store the LR catalog on the same drive as my photos? Today the program, the catalog and the photos are all

    I use LR5.7 based on Windows 7 and got a few pictures 150 000 in a catalugue. Could import, export and rendering speed be increased, if I store the LR catalog on the same drive as my photos? Today, the program, the catalog and photos are all on different drives.

    Import and export and rendering speed depends on the CPU. The disk contributes only a negligible amount to import and export and rendering speed. You would spend more time to pass the photos that you would gain in speed.

  • Trying to open a corrupted catalog extracted from the software recovery but shows 0 bytes.

    Trying to open a corrupted catalog extracted from the software recovery but shows 0 bytes.

    Hi pibo1984,

    As the catalog size is 0 bytes, this means that the catalog has no inside information.

    So I suggest you to please try to work with one another your backup catalog.

    Kind regards

    Tanuj

Maybe you are looking for

  • Implementation of HP Deskjet 2540 All in One

    Hi, I created this printer with my last provider internet and router easily. When I got the new router, the printer do not connect so I'll try to put in place to work. I've uninstalled and reinstalled the software, but move to the part of the 'discov

  • Wii can not connect to the router

    Please HELP, can't connect to router wants have changed the password password several times guard commin back with security codes cannot connect to internet... Please someone help

  • BlackBerry Z10 Native E-Mail BlackBerry 10

    Hello I am a current OS 7.1 Torch 9860 user. I think the upgrade to BB10 in the coming months. At least with blackberries inherited, we can't use native email without a data plan. Considering that the BB10 devices don't use bis (BlackBerry Internet S

  • Smartphones blackBerry push email/off switching voltage

    I just got an 8120 pearl with orange Don't have the bolt e-mail push on (too tight to pay£ 7.50) but managed to associate my e-mail address of the phone. Also, I connected the phone to my home WiFi. I wanted to get my e-mails via wi - fi, so if I wor

  • I can't open .eml in windows live mail. prohibited file type?

    I get mail from a conact and I can't open attachments. When I try, I get a message that it's a "forbidden .eml file Type" and may not open. I have Windows 7 amd and the 64 bit OS. What is the solution please?