Converting large amounts of points - 76 million lat/lon to space object...

Hello, I need help.

Platform - Oracle 11g 64 bit on 64-bit Windows server 2008 Enterprise. 64 GB of ram with 2 processors for a total of 24 cores

Does anyone know a quick way to convert large amounts of points of a space object? I need to convert lat/lon st_geometry ESRI or Oracle sdo_geometry 76 millions.

Currently I have the configuration code using parallel functions in pipeline and several jobs that run at the same time. It takes still more than 2.5 hours to deal with all the points.

Pointers would be GREATLY appreciated!

Thank you

John

Hello

Where is the lat/long data at this time? In an external text file or in an existing database table as attributes numbers?

If they are in an external text file, then I'd probably use an external table to load them in as soon as possible.

Are they in an existing database table, then you can just update the column sdo_geometry to help:

update set = sdo_geometry(2001, , sdo_point_type(, , null), null, null)
where is not null
and is not null;

That must run very fast for you. If you want to avoid the overhead of creating again, you can use "create table... as select... ». This example of creating 1 000 000 points works in 9 seconds for me.
create table sample_points (geometry) nologging as
(select sdo_geometry(2001, null,
sdo_point_type(
trunc(100000 * dbms_random.value()),
trunc(100000 * dbms_random.value()),
null), null, null)
from dual connect by level <= 1000000);

I have the configuration code using parallel functions in pipeline and several jobs that run simultaneously
You must use pl/sql for this task. If you find you, then provide a code example and we'll take a look.
Kind regards
John O'Toole

Tags: Database

Similar Questions

Memory management by displaying the large amount of data
Hello
I have a requirement to display the large amount of data on the front in table 2 & 7 graphic during the time period 100hrs for 3 channels, data read from strings must be written in the binary file, and then converted and displayed in front of the Panel for 3 channels respectively.
If I get 36 samples after conversion for all hours, up to 83 h 2388 samples displayed in table and graphical data are thin and samples correspond exactly.
After that 90 hours 45 minutes late is observed after theoretical calculation of samples, what could be the problem
I have controller dual-core PXI8108 with 1 GB of ram
As DFGray,
says there is no problem with the RAM or display, problem with conversion (timming issue) if I am data conversion of large amount it takes even, compared to the conversion less amount of data. So I modifed so that each data point Sec 1 is convereted at once, problem solved
Thanks for your replies

3000N200 R &amp; R backup takes hours and using the large amount of disk space. Can anyone help?
The weekly backup of Rescue and Recovery has suddenly started to take hours when I haven't changed anything and uses a large amount of hard disk space. I tried to remove some previous backups and it and it seemed to work OK and then all of a sudden decides to do the same thing. I tried a previous restore point and it helped for a while and now just made a backup taking 4 hours and 20 GB of hard drive space. It is a fault and has nothing to do?

Windows is losing large amounts of storage space without telling me
In recent weeks I've been watching my local disk drive (c) (only the petition on that computer) to see if I was using storage space. I noticed that I am losing a large amount of storage space. AVG disk space analysis, I have 176 GB of files in my local disk (c). My windows Explorer, however, I have 335 GB of files on my local drive (c). Which means there are 159 GB of files in my PC that I never new existed, and I can't find where. My concern is that it is a form of Malware, like in the last 24 hours, I've lost 15 gb + space, even if I haven't downloaded something.
I apologize if it was a little hard to follow, as I found it hard to explain. If anyone knows what it is, if it is in fact something, please share your information with me. Thank you.
Riley
There could be lots of things like backups, restore points, etc. There is a 3rd party app called from Jam software Treesize (free) which will tell you what is using that space.

When I scroll with the wheel of the mouse Microsoft Wireless Mobile Mouse, it jumps instead of sliding to the bottom of the page. It ignores even the large amounts. This can be solved? Rose
When I scroll with the wheel of the mouse Microsoft Wireless Mobile Mouse, it jumps instead of sliding to the bottom of the page. It ignores even the large amounts. This can be solved? Rose
Hi Rose,

The problem occurs on specific applications?

This can be for one of the following reasons:
1. bad mouse is selected in the IntelliPoint software.
2. conflict with other mouse or pointer (non-Microsoft) software.
3. problem with IntelliPoint software or drivers.
4 application does not correctly recognize scrolling the mouse messages.

I suggest for the link and follow the steps in the KB article:
The problems with the mouse button or scroll the parameters

http://support.Microsoft.com/kb/303091

Note: Put the computer to normal mode after the troubleshooting in clean boot mode.

Hope this solves the problem. If the problem persists, you can write to us and we will be happy to help you further.

Looking for ideas on how to get large amounts of data to the line in via APEX
Hi all
I am building a form that will be used to provide large amounts of data in row. Only 1 or 2 columns per line, but potentially dozens or hundreds of lines.
I was initially looking at using a tabular subform, but this feels like a method heavy since more than an insignificant number of lines.
So now I'm wondering what are the solutions others have used?
Theoretically, I could just provide a text box and get the user to paste in a list delimited by lines and use the background to interpret code on submit.
Another method that I've been thinking is to get the user to save and download a CSV file that gets automatically imported by the form.
Is there something else? If not, can someone give me any indication of which of the above would be easier to implement?
Thank you very much
PT
Hi PT,.
I would say that you need a loading data wizard to transfer your data with a CSV file. 17.13 Creating Applications with loading capacity of data
It is available for apex 4.0 and distributions, later.
Kind regards
Vincent
http://vincentdeelen.blogspot.com

Importing a large amount of text in InDesign (Newbie question)!
Hi all
I'm new to InDesign and would appreciate some advice/tips on the best way to transfer a large amount of text from Microsoft Word into an InDesign document. I was tasked to create a very simple pocket-sized book, whose content will be a series of business acronyms (700 +) and their definitions (imagine a very simple dictionary). As you can imagine there are a lot of text in the Microsoft Word document, so any advice on how to transfer everything as quickly as possible would be really useful. Or, where appropriate, it would be easier to use another program?
Can you paste/import all - or chunks-a document word at once? If I format a master page will be Adobe InDesign paste the text in the number of pages required? Or do I have to do it page by page in a Clipboard?
Of course, I don't expect InDesign to format the text perfectly on every page, I want to just throw everything at once and then go back and he put all this.
Any help or advice would be greatly appreciated.
Concerning
Matthew
File > Place... and navigate to the Word file. Show Import Options to allow you to preserve the formatting of Word, or throw, or card styles styles in your document of identity.
If you have a block of text on your master page, place the cursor loaded above the area of the image on your document page and watch for the cursor change if it is surrounded by parentheses, then hold down the SHIFT key and click. If you do not have a Master frame (and more experienced users will tell you that more than 90% of the time a block of text type is more hindrence than help if you set your margins correctly), hold down the SHIFT key and click where you want the top of the first column to get started.
In both cases, ID will add pages as necessary to place the entire document and thread text across all frames. If using frames of masters, they will be linked and overrridden on the page of document automatically, otherwise, your first image will begin where you click and extend to the bottom margin and succeeding frames will fill the column guides (so talk to your margins correctly).
ID is a professional software and you really need to spend time to learn how it works. A good starting point is the help files. Another is Visual QuickStart Guide of Sandee Cohen of InDesign. If you prefer video training, Lynda.com has good content.

Advice needed on the way to store large amounts of data
Hi guys,.
Im not sure what the best way is to put at the disposal of my android application of large amounts of data on the local device.
For example records of food ingredients, in the 100?
I have read and managed to create .db using this tutorial.
http://help.Adobe.com/en_US/air/1.5/devappsflex/WS5b3ccc516d4fbf351e63e3d118666ade46-7d49. HTML
However, to complete the database, I use flash? If this kind of defeated the purpose of it. No point in me from a massive range of data from flash to a sql database, when I could access the as3 table data live?
Then maybe I could create the .db with an external program? but then how do I include this .db in the apk file and deploy it for android users device.
Or maybe I create a class as3 with a xml object initialization and use it as a way to store data?
Any advice would be appreciated
You can use any way you want to fill your SQLite database, including using external programs, (temporarily) incorporation of a text file with SQL, executing some statements code SQL from code AS3 etc etc.
Once you have filled in your db, deploy with your project:
http://chrisgriffith.WordPress.com/2011/01/11/understanding-bundled-SQLite-databases-in-AI r-for-mobile.
Cheers, - Jon-

Update of Microsoft using large amounts of resources
I have 2 computers with Microsoft update by using a large amount of RAM. Wuauclt.exe and svchost.exe eat so much memory that do not complete the updates. This happened for a few weeks and have just been told. I have reset the updates that did not help. I disabled Microsoft Updates which seems to fix the problem. A system has 512 MB of RAM and Norton AV, the other has 1 GB of RAM and NOD32.
Hi Chris,
Method 1:
First of all I suggest you enable Microsoft Updates for your computer. An analysis online for your computer from the link given below, because this can be a problem if your computer is infected by viruses or malware.
http://OneCare.live.com/site/en-us/default.htm
Method 2:
In addition, would suggest you use the (SFC.exe) System File Checker tool to determine which file is causing the problem and then replace the file. To do this, follow the link below.
Description of Windows XP and Windows Server 2003 System File Checker (Sfc.exe)
http://support.Microsoft.com/kb/310747/en-us
Hope this information is useful.
Amrita M
Microsoft Answers Support Engineer
Visit our Microsoft answers feedback Forum and let us know what you think.

AppleMobileDeviceService.exe use a large amount of memory
Original title: Applemobiledeviceservice.exe
I am running XP Professional and have installed MSE on the computer as my antivirus software. I have 2 GB of memory and has recently added SpeedyPC Pro to improve performance. Today my PC was slow and open the Task Manager and saw that applemobiledeviceservice.exe used a large amount of memory. I think my daughter has added years back, but she no longer uses this computer. Do I need? If this is not the case, how can I remove it?
See you soon
SpeedyPC... what a scam.
Ask the question in the Apple Forums:
https://discussions.Apple.com/index.jspa

I have an e mail with quite a large amount of attachments, sitting in the Outbox in Windows Mail. In my view, that attachments are at the origin of the problem.
I have an e mail with quite a large amount of attachments, sitting in the Outbox in WINDOWS MAIL. In my view, that attachments are at the origin of the problem. As soon as I open the mailbox the arrow in bottom corner shows right 'sending mail '. It just continually seeks to send it, so I can not receive or send other emails. I tried to delete this mail in the Outbox by highlighting and click 'delete', but nothing happens. I have a desktop Compaq Presario SR 5633 WM
original title: sending mail windows problem
Verifier check first to work offline , and then delete the Outbox.

Is it better to transfer usb2, eSATA (or usb3) in small quantities or large amounts of data? Corrupted data?
Not sure if this should be in performance/maintenance or hardware/drivers.
Hello. I was wondering about the usb2, eSATA and a bit on the usb3. I have usb2 and eSATA on my systems.
Someone I work with told me that there may be corrupted data if you transfer a large amoutns of data via Usb2. It is best to break your files to move, copy, etc., he said. My colleague told me earlier that anything more than 30 or 40 GB start to be transferred correctly from external factors or for some reason any.
These issues apply to eSATA or Usb3? I guess not, since these other methods are designed to transfer large amounts of data.
Is this true? Is this due to material limitations? What is the recommended size of transfer? It's Windows XP, Vista or 7 limits?
Any info or links are appriciated.
Thank you.
I have never heard of something like this before and have done some fairly large data movements in the past. I would recommend using the program Robocopy in Windows Vista/Windows 7 (and available for Windows XP as a download add-on) to drag the move instead of type / move, given that Robocopy includes a number of features and security provisions that are not present in the case.
'Brian V V' wrote in the new message: * e-mail address is removed from the privacy... *
Not sure if this should be in performance/maintenance or hardware/drivers.
Hello. I was wondering about the usb2, eSATA and a bit on the usb3. I have usb2 and eSATA on my systems.
Someone I work with told me that there may be corrupted data if you transfer a large amoutns of data via Usb2. It is best to break your files to move, copy, etc., he said. My colleague told me earlier that anything more than 30 or 40 GB start to be transferred correctly from external factors or for some reason any.
These issues apply to eSATA or Usb3? I guess not, since these other methods are designed to transfer large amounts of data.
Is this true? Is this due to material limitations? What is the recommended size of transfer? It's Windows XP, Vista or 7 limits?
Any info or links are appriciated.
Thank you.

Spooler SubSystem App process in Windows consumes a large amount of memory
Hello
I have HP B110a (all in a single combo)
The system is Windows 8.1
Drivers - HP's new web site.
There is no problem of instalation and connection via USB and wireless.
But I noticed a problem with the Wi - Fi - process Spooler SubSystem App (spoolsv.exe) consumes a large amount of RAM memory, it has even 1, 5 GB! I note that the C:\Windows\System32\spool\PRINTERS catalog is empty - it happens when the printer is in sleep mode, not printing or scanning.
Problem does not occur for the USB connection.
Any advice? I think that this is a problem in the printer driver.
I will be grateful for your help, because I can't use all the features of the device.
Best regards, Masson
Hi man,
I understand that you have all the features of your HP B110a. I recommend that you use printing HP and doctor Scan.
HP printing and doctor Scan is a free utility (tool) that allows to quickly solve common printing, scanning and connectivity problems. HP recommends that you run the tool every time that you need to solve a problem.
Printing and scanning doctor diagnoses and resolves common printing, scanning and connectivity problems, including:

Impossible to transfer large amounts of data more than 10 GB
Original title: the maximum data transfer size?
I recently installed an eSata controller card in location faster PCIex-1 of my computer to benefit from a transfer of data to and from my Fantom drives GreenDrive, of 2 TB external HARD drive. When I started to copy the files from that drive to a new drive HARD internal, I recently installed I could not transfer large amounts of data more than 10 GB. The pop-up message indicating files preparing to copy, then nothing would pass. When I copy or cut smaller amounts of data all works fine. Perplexed...
I think I got the question. It seems that some of the files I transfer were problematic. When I transferred in small amounts, I was then invited for what I wanted to do about these files. Thanks for the reply!

With the help of the network location and mapped a drive to the server FTP. during the transfer of very large amounts of the login information is always lost.
With the help of the network location and mapped a drive to the server FTP off site; during the transfer of very large amounts of the login information is always lost. Computer power settings are configured to not to do no matter what, I'm assuming that the ftp server can publish a scenerio timeout but is there a way for my computer and windows to restart the file transfer?
Hello
Thanks for posting your question in the Microsoft Community forums.

I see from the description of the problem, you have a problem with networking on the FTP server.

The question you posted would be better suited in the Technet Forums. I would post the query in the link below.
http://social.technet.Microsoft.com/forums/en/w7itpronetworking/threads
Hope this information helps you. If you need additional help or information on Windows, I'll be happy to help you. We, at tender Microsoft to excellence.

Converting large amounts of points - 76 million lat/lon to space object...

Similar Questions

Maybe you are looking for