Easy replacement of a source data store
Hi gurus,Is there an easy way to replace a data store source by another with the same structure in an interface?
Without having to redo the join, filter and the column mapping target.
Thanks for your help.
Concerning
user1459647 wrote:
I thank you for your quick response and says.Unfortunately, when I delete a data source store, all joins/filters involving this data store disappear.
This will happen if your join filter/condition is specified only on 2 tables and 1 of them is deleted.
And all the mappings of target involving this data store are set to 'Target' instead of 'Source' (not a big deal).
View the area of execution, you can
Is there something to change in my settings ODI Studio?
I don't think so
I use Windows 7 and ODI 11.1.1.5.
That should be fine.
You can explore the SYNONYM option too :)
Tags: Business Intelligence
Similar Questions
-
Filter on the Source data store
Hello
I am new to ODI. My source and target are the two Oracle. I have a table in the Source that has 10000 files. I Reversed engineer the source table and was able to view the data on the source data store. However, I want to filter the data on the source to send only rare recordings and not all 10000. I am writing a filter on the Data Source on a particular column store, but I still see all the records when I click Show data. Any suggestions?
Thank you
Arun
Edited by: user9525002 May 19, 2010 09:26
Edited by: user9525002 May 19, 2010 09:54Arun,
I don't think it's possible. You want to look at the filtered source data before loading to make sure that only correct data is loaded into the target.
A little more complicated would be to create a temporary interface (interface yellow) by selecting the Sunopsis Memory engine than the target temporary table.
And then right-click to display on this memory temporary table data. -
Constraints in the target or source data store?
Hello
When I put a constraint (condition) in my store of data source, the constraint works great when I just test it by clicking on the table by clicking on "Control-> errors. All errors are displayed in a list. But when I run my script uses the data/table store, my db target takes all the lines even those that "should" have failed.
When I read the Guide ODI I see a note on page 57 stating the following:
"Only the declared constraints on the data target in its model store are in the constraint list".
So can someone please explain to me why you would put constraints in the source data store if they cannot be used in a scenario/interface?
Best regards
M1 > check if the script, which works very well, is a newer version than what you use in the package.
2 > why don't place you the constraint on the source and test?See you soon
Foam -
Source data store Session failed
Hello
I have a request suppose I have an interface for ELT files.
and the source file is replaced by another process after certain time interval.
Suppose that during the integration of the data if the db connection failed then where can I get the
data from the CBC. (assuming that src file is overwritten and we have no direct access to the src file system)
Thank you
Papai
Hi Sarah Perreault,.
You can add a step in your package or workload to copy the file in a directory to archive if the interface fails.
In a package, add a (red) KO link between your interface and a tool of OdiFileCopy (and optionally an OdiSendMail to be notified). For a load Plan, add an exception step to do the same.
Kind regards
JeromeFr
-
Hello experts,
I've created an interface when an xml file is reversed in the form of a source data store. Xml data are pumped into a target of oracle db. All this goes well.
I'm creating a scenario where I get an xml file from a ftp server on a daily basis (with agent). This new xml file has the same structure as that already used in the interface. The question is: How can I update the data in the xml data store?
I tried to replace the original xml file, but it does not work and cdc does not seem to apply here, I searched for quite a while now.
Thank you very much!
YvesHello
See if that helps
XML for the interface Oracle even insert County regardless of input XML fileThank you
Fati -
VMware ESXi 5.0 - "move to" data store a vmdk file has left at the original location
Hi all
I had to free up space on a SAN data store. For this I used the function "move to...". "browser data store in VsphereClient.
Did not notice directly but after I moved my E: drive vmdk file, he took no source data store.
How can I make sure that vmdk (the source data store) may be deleted without impact on the vm?
1. If 'vmkfstools d' report without lock, so I guess I could assume it is safe? Is there another way to check?
2 vmkfstools seems not having the '-d' option in vSphere CLI? (East - this only accessible from ssh console on an ESXi? quid vCenter then?)
In the data store, the files were:
-Vm\win2k8_data.vmdk [SAN03] (data disk D :)
-[SAN03] vm\win2k8_data - ctk.vmdk (-ctk looks that it has been created by Veeam)
-[SAN03] vm\win2k8_transactlog.vmdk (E: transaction log 128 GB drive)
-[SAN03] vm\win2k8_transact - ctk.vmdk (-ctk always assuming that it was created by Veeam ~ 8 MB)
Steps to follow:
-J' turned off the virtual machine using these car
S ' installs 2 files on the E: drive
-Removed the vm disk (<-my mistake? maybe this step left a lock file? in power vm off?)
-Added the disk from the data store where I copied it
Thanks for the help!
behd
Hi Behd,
The best way to check if the vmdk on the source is not being used would be to add this vmdk to an existing virtual computer and turn on... ? If not used or is locked by one that turns on with success.
If it has an instance running it wouldn't let you put under tension and raise an error of file locking. ?
Avinash-
-
VM does not far from data store
Hello
I'm under 5.1 and 5.1 ESXi vcenter
These days I use storage vMotion to organize my warehouses... well but I have 3 data warehouses where I move 4 virtual machines to another data store (new size 3 TB of dastore)
but they are still recorded in the source data store where there is nothing in this old data store: no CDROM ISO, no file VMX, all virtual disks are in the new data store
The old navigation data store shows nothing related in this datastore with these virtual machines.
no idea what could cause this problem when I move completely these virtual machines to the new data store, but they will still show in the old
Thank you very much
Data warehouses reasons other than the data store 'House' is displayed are:
- the entries in the settings of the virtual machine (image .iso for CD-ROM drive, .flp images to floppy drives)
- Active snapshots, where such a link existed at the time you created the snapshot
André
-
check the free space on the data store before making svmotion
I'm trying to understand how to check free space on the data store until the proceeds of the svmotion.
Example:
-must first check that that sizeof (VMs to be moved) < sizeof (destination) - 50 GB before in terms of the
-should leave a 50 GB buffer so that the script ends when all the VMS are moved from source data store or there are only 50 GB left on the source data store
-must move VM to store data source to the destination data store 2 at a time, until the completion
-must create a local log file, and then send this log file using the relay smtp server.
I just started using powershell and have played with different things for about a week. I'm trying to understand this problem, anyone has advice or suggestions for me?
Any help would be greatly appreciated...
Hello
Yes, the $vmname is empty, change the line as below
Move-VM -VM (Get-VM -Name $vmm.Name) -Datastore (Get-Datastore -Name $DSname)
-
Source and target data store mapping query
I have to get the source and mapping target in ODI interface.
Which table will I hit to get mapping information.
E.g.
Interface: INT_SAMPLE
Data store: Source_DataStore with columns (cola, colb, teachers) Target_DataStore with columns (cola, colb, cold)
Well mapping cover the QuickEdit tab and expand the field of mapping mapping is so
Source_DataStore.Cola = Target_DataStore.Cola
Source_DataStore.colB = Target_DataStore.colB
Now, I want to get mapping information above as well as the name of the interface and the rest of the column that are not mapped using SQL (is it possible to trick ODI for mapping).
Are you looking for an application to run on the repository?
If so, it can help:
select I.POP_NAME INTERFACE_NAME, ds.ds_name DATA_SET , s.lschema_name SOURCE_SCHEMA, NVL(S.TABLE_NAME, S.SRC_TAB_ALIAS) SOURCE_TABLE , mt.lschema_name TARGET_SCHEMA, I.TABLE_NAME TARGET_TABLE, c.col_name TARGET_COLUMN, t.FULL_TEXT MAPPING_CRITERIA from SNP_POP i, SNP_DATA_SET ds, SNP_SOURCE_TAB s, SNP_TXT_HEADER t, SNP_POP_MAPPING m, SNP_POP_COL c, SNP_TABLE trg, snp_model mt where I.I_POP = DS.I_POP (+) and DS.I_DATA_SET = S.I_DATA_SET (+) and T.I_TXT (+) = M.I_TXT_MAP and M.I_POP_COL (+) = C.I_POP_COL and M.I_DATA_SET = DS.I_DATA_SET (+) and C.I_POP (+) = I.I_POP and I.i_table = trg.i_table (+) and trg.i_mod = mt.i_mod (+);
Just add a filter on UPPER (I.POP_NAME) = UPPER ('
'). Kind regards
JeromeFr
-
Hi all
I have an existing file with HD Server configures:
HD1: 60 GB
HD2: 20 GB
HD3: 650 GB
Total: 730 GB
I intend to shrink HD3 250 GB that will give me a new total of 330 GB.
My question is, when I rode the VMware Converter Standalone process and I get to the step where I select the 'destination '. Obviously, I need to select a data store that can adapt to the virtual destination machine.
My concern is that it shows the size of the source disk (Go 730) (see image below), and for some reason any part of the conversion process the destination data store requires the storage of the size of 330 GB vm 730GB as opposed to the 'new '.
Can anyone confirm?
Thank you
There are no for the data store 730 GB free in order to submit the conversion. 330 GB free (size after reduction) would be sufficient.
If you also select a provisioning, you could even start the conversion with less free space on the data store, but it may fail at some point, if the actual data meet.
-
Replacement of a data store - migration of virtual machines
We have a VMware ESXi 4.0 installed on a SD card and our data store is on a dedicated internal RAID array. Our data store is running out of space... what we would do is remove the old hard drives and add new - therefore, delete and re-create the matrix RAID and the data store.
What is the best way to migrate our existing data store / VMs from the old array to a new one using vSphere or vSphere CLI? How we then re - associate VMs on the SD card with the new data store? Advice would be appreciated. Thank you very much.
Hello
Looks like it's a single ESXi host.
You will need to copy/save all the contents of the data store existing to another location (external HARD drive) while all virtual machines are closed.
Once it's done and you are sure that the copied data are intact, you can:
-remove all virtual machines of the inventory
-remove the data store
-Stop the host
-replace the HARD drive with the new
-Launch the host and to reconfigure the new raid
-Create the new data store in ESXi
Copy/restore all data to the new data store
-Browse the data store and add all the virtual machines to the inventory (create a list to make sure you get all the)
-Start the virtual machines
May be a good time to do an upgrade of ESXi5 as well
Please allow points to useful/correct answers
-
Data store rename using replace?
I am trying to rename more than one store of data at once.
Scenario:
Have a number of local ESX hosts with several warehouses of data, in this case two. Now I would like to rename from the default datastoreX to & lt; Server name & gt; vmfsX. So that the number remains the same but the data store is replaced.
for example, datastore1 becomes esx1vmfs1, and datastore2 becomes esx1vmfs2.
Yes, I could simply run two commands because all the servers that I'm building will have only two data stores, but this is not the point and I'm trying to improve my skills of PowerShell. Since I did a change of name of the files in a file system quite easily, I thought I could try the same approach method replace.
So the code I started with:
$vmhost = Get-VMHost -Name MyESX.company.com $vmhostshortname = $vmhostname.Split(".")[0] $dsname = $vmhostshortname + "vmfs" Get-DataStore -VMHost $vmhost | Where-Object { $_.Name -like "datastore*" } | Set-Datastore -Name { $_.Name -replace "datastore", $dsname }
Returns:
Set-Datastore : 11/02/2010 3:16:38 PM Set-Datastore 52d79783-f475-a27f-1ec7-2f84b214241e $_.Name -replace "datastore", $dsname ' is invalid or exceeds the maximum number of characters permitted. At line:1 char:92 + Get-DataStore -VMHost $vmhost | Where-Object { $_.Name -like "datastore*" } | Set-Datastore <<<< -Name { $_.Name -replace "datastore", $dsname } + CategoryInfo : NotSpecified: (:) [Set-Datastore], ViError + FullyQualifiedErrorId : Client20_MoServiceImpl_Invoke_ViError,VMware.VimAutomation.Commands.SetDatastore
It's basically trying to define the data store to all characters between the brackets.
Then I tried this instead,
Get-DataStore -VMHost $vmhost | Where-Object { $_.Name -like "datastore*" } | % { $newname = $_.name -replace "datastore", $dsname; Write-Host $newname; Set-Datastore -Name $newname }
Returns:
Set-Datastore : Value cannot be found for the mandatory parameter Datastore At line:1 char:169 + Get-DataStore -VMHost $vmhost | Where-Object { $_.Name -like "datastore*" } | % { $newname = $_.name -replace "datastore", "$dsname"; Write-Host $newname; Set-Datastore <<<< -Name $newname } + CategoryInfo : NotSpecified: (:) [Set-Datastore], ParameterBindingException + FullyQualifiedErrorId : RuntimeException,VMware.VimAutomation.Commands.SetDatastore
So apparently not to evaluate $newname or at least it stays together.
I checked that $_. Name of the data store is a string object.
If I replace it outside the line, as below, it works as expected.
$dslist = Get-Datastore $newname = $dslist[0].Name -replace "datastore", $dsname
I'm sure that I'm either missing something simple, or there is another way to do it, but I'm jiggered if I can get by.
Try this way, that should work
$vmhost = Get-VMHost -Name
$vmhostshortname = $vmhost.name.Split(".")[0] $dsname = $vmhostshortname + "vmfs" Get-DataStore -VMHost $vmhost | Where-Object { $_.Name -like "datastore*" } | %{ $_ | Set-Datastore -Name ($_.Name -replace "datastore",$dsname) } The problem with your last attempt, is that it has no DatastoreImpl object in the hose that can server as a value for the parameter - data store.
____________
Blog: LucD notes
Twitter: lucd22
-
Help adding extensions to a VMFS data store
Hello people,
I am working on some automation for creation of data store and must be able to add extensions to a data store. The initial creation of data store works well enough at this point, but I'm a little puzzled about how to add additional extensions. In my example, I am using the navi cli to make the LUN UID off the coast of the Bay of EMC, then format it correctly for the canonical name the host for the creation of data store.
I read a little about the extendvmfsdatastore here , but I am not able to separate the part "add the measure" of "questioning the existing data store and remove references to pass." If someone has an extract whose orders must be performed and the text to pass to the .extendvmfsdatastore method, I'd be very happy. I know measure in several data stores fall into disgrace with VMware, but I can't migrate 10TB data storage immediately.
Thanks in advance!
Brent
omitted variable section
**********************
to connect-viserver $VC - https protocol-$VC_USER the username-password $VC_PASSWORD
Import-CSV C:\PowerShell\VNX_buildout\TEST-DSCreate\Test_DSCreate.csv | {Foreach}
$LUN = $_.alu
Naviseccli-address = $UID $VNX_ADDRESS-User $password-VNX_USER_NAME $VNX_PASSWORD-scope 0 lun-list-l $LUN - uid. out-string
$UID = $UID. Replace (":", "")
$POS = $UID. IndexOf("6006")
$UID = $UID. Remove (0, $pos)
$CN = $UID. Substring (0.32)
$CN = "naa. $CN ".
write-host "CN = $CN - Array MONDAY = $LUN"
New data store - VMHost $ESX_HOST-name $_ .datastr-path $CN - Vmfs-confirm: $false
DataSet datastore store-$_.datastr - storageiocontrolenabled $true# Add the extensions of vmhbax:C:T:L or naa.xxx or?
}I have reviewed the procedure I used, seems that there is an easier way to do it.
You can try this version of the script?
$esxName = "MyEsx" $tgtDSName = "MyDS" $freeLUN = "naa.6005076801801a34d000000000000078" $esx = Get-VMHost -Name $esxName $dsToBeExtended = Get-Datastore -Name $tgtDSName -VMhost $esx $dsSystem = Get-View $esx.ExtensionData.ConfigManager.DatastoreSystem $available = $dsSystem.QueryAvailableDisksForVmfs($dsToBeExtended.ExtensionData.MoRef) $lun = $available | where {$_.CanonicalName -eq $freeLUN} if($lun){ $options = $dsSystem.QueryVmfsDatastoreExtendOptions($dsToBeExtended.ExtensionData.MoRef,$lun.DevicePath,$true) $dsSystem.extendVmfsDatastore($dsToBeExtended.ExtensionData.MoRef, $options[0].Spec) }
If the LUN that you pass the $freeLUN variable is not free, the script will not call the extendVmfsDatastore method
-
Prevent write access to a data store
All,
I hope someone can advise me on this problem?
The scenario:
We have introduced a new LUN in our ESX 4.0 cluster, configured as a data store VMFS and storage vmotion to migrate from a number of virtual machines on this data store. Each virtual machine is turned off. Logic unit number is presented an IBM DS8100 storage array. At a specified time, the LUN is migrated to a remote data center, where we intend to present the LUN to a cluster of replacement and saving virtual machines on this LUN. This provides a method of migration of virtual machines between remote sites.
The problem is when we test this guy storage advise that there are tracks out of sync in the replicated data, which they claim is due to the LUN writes during replication (which seems unlikely that all the virtual machines on this LUN were stop). According to me, the question is at the end of storage but have been asked to determine if there is a method to isolate completely the LUN of the cluster ESX source to ensure that no data is written during the migration.
The methods that I have considered are:
(1) delete the data store - not a viable option that he would destroy all data on the LUN.
(2) turn off all the paths to the data store by using the vSphere client. It resembled a possibility - I can deactivate 3 of the 4 paths to an ESX host, but get an error when I try to disable the fourth.
(3) use esxcfg-mpath to disable paths - not convinced that this will work any different use of the GUI.
(4) get the guys from storage to use to prevent ESX hosts to 'see' the LUN of LUN masking. My problem with this is how ESX will react if she can't see the data store.
My question is, is anyone know of any method I can use to ensure that this LUN cannot be written in during the migration to the remote site?
Many thanks in advance,
Martin
Yes, ESX will complain, but once you log LUN return - everything will be ok.
Remove the inventory of VMs (but don't delete disk) before disconnection LUN and ESX will not say anything.
---
MCSA, MCTS, VCP, VMware vExpert 2009
-
Getting property of type 'Date' from a PDO data store
It is therefore a question of both parties. Part A: when I search for data in a data store, to find data by using the object Navigator returns the correct number of results, using the object. GetElementList does not work. I'm looking in the data store for steps created between a certain date (using the iStartTime property). It seems that they must return the same results. Please see part A of my code pasted below. Any suggestions? Perhaps it is - that it is related to part B of my question.
Part b: iStartTime property is the data type 30, or of type Date. When I try to access the value of the property of iStartTime I got an error stating that ' the object does not support this property or method ". Is there a special way to get the value of a property when the property is a date?
Any suggestion would be appreciated!
-Russ
Option Explicit ' force explicit declaration of all variables in a script.
Dim MyElementList, oMyDataStore, StartDate, EndDate, MySearchStringMyDataStorePlugin Sun: myDataStorePlugin = 'PDO '.
MyDataStoreParam Sun: myDataStoreParam = "AVL 7D667E7B1EBFBAB6736F66010CCAB1AC8CB28FD2 ROCMSAPP01 600000000 YES YES YES auto "
Set oMyDataStore = Navigator.ConnectDataStoreByParameter (myDataStorePlugin, myDataStoreParam)StartDate = Cdate (DateAdd("d",-3,Date)) + TimeSerial (0,0,0)
EndDate = Cdate (DateAdd("d",0,Date)) + TimeSerial (23,59,59)'------------------------------------------------------------------------------------------------------------------------------------------------
' PROBLEM A: THESE TWO SEARCH SHOULD BE THE SAME, BUT THEY RETURN DIFFERENT results.
"This returns zero search results."
Set MyElementList = oMyDataStore.GetElementList ("Action", "iStartTime > =" & StartDate & ") iStartTime<=" &="">=">
MsgBox ("GetElementList count:" & MyElementList.Count)«That returns 18 results»
Dial the navigator. Display.CurrDataStore.Browser.refreshALL
Call Navigator.Display.CurrDataStore.QueryForm.Clear
Call Navigator.Display.CurrDataStore.QueryForm.Conditions.Add("Measurement","iStartTime",">=",Startdate) ' here is where I add a new condition.
Call Navigator.Display.CurrDataStore.QueryForm.Conditions.Add ("action", "iStartTime" "<=",EndDate) 'here's="" where="" i'm="" adding="" a="" new="">=",EndDate)>
Navigator.Display.CurrDataStore.QueryForm.Conditions.Logic = "C1 AND C2.
Navigator.Display.CurrDataStore.ResultsList.Elements.MaxCount = 10000
Call Navigator.Display.CurrDataStore.QueryForm.Search () ' and that triggers the search according to my requirements and the data store I went.
MsgBox ("browser search count:"& Navigator.Display.CurrDataStore.ResultsList.Elements.Count ")'------------------------------------------------------------------------------------------------------------------------------------
«PROBLEM B: iStartTime IS DATA TYPE 30 OR DATE TYPE.» HOW TO ACCESS THE VALUE?MsgBox ("identification data type:" & Navigator.Display.CurrDataStore.ResultsList.Elements.Item (1).) Properties.Item ("Id"). DataType) "Message:" data type Id: 3 ""
MsgBox ("Id value:" & Navigator.Display.CurrDataStore.ResultsList.Elements.Item (1).) Properties.Item ("Id"). Value) "Message:" Id value: 266888 ""MsgBox ("iStartTime data type:" & Navigator.Display.CurrDataStore.ResultsList.Elements.Item (1).) Properties.Item ("iStartTime"). DataType) "Message:" type of identification data: 30 ""
MsgBox ("iStartTime value:" & Navigator.Display.CurrDataStore.ResultsList.Elements.Item (1).) Properties.Item ("iStartTime"). Value) ' results in error, the object does not support this property or methodSorry, I've replaced iStartTime by measurement_begin to make it work on my local database :-)
The point is that the syntax of GetElementList is the following
"iStartTime > = 20121201033; iStartTime<>
When converting a CDate to str it cause string locale-dependent.
But the suggestion would be to use the
Dim query: query = oMyDataStore.CreateQuery set
instead of the query string. Because he avoid conversion errors. Be aware that even a double value to a string in Germany for example will convert a written decimal number while the stringquery expects at this point notation.
Set MyElementList = oMyDataStore.GetElementList ("Action", "measurement_begin > =" & RTT (StartDate, "#YYYYMMDDhhnnss") & ") measurement_begin<=" &="">=">
must provide correct results.
Maybe you are looking for
-
I received an email from fake a misc account claiming to be sending Apple, telling me that my account information seem to be missing or incorrect and need me to verify my account information to continue using my Apple ID by clicking on a link below,
-
Loading tab is often incomplete
Hello team! First of all, I must stress that I like in general Firefox as browser. However, there are a few problems quite annoying in my version of it, I hope it's the latter! (Version 41.0.2) All of the following terms refers to open a new tab. I h
-
I did a search and he came empty. What is the beaker next to a screen name of people? I've been away a while.
-
DV7 - 6160ca usb 3 drivers does not
So I did a fresh install of windows 7 on this laptop and the whole left side usb does not work and I can't get the usb3 drivers to load. I downloaded several different drivers on the website and none worked. The laptop has only four days.
-
Transfer of large file to external drive
I'm trying to transfer a big file (4.5 GB movie .mpeg) of my computer on an external hard drive. The external drive has 320 GB of space with 82 GB used. I get the following message appears when I try to move the file "the file _ is too large for the