reconfigure the queues

Hi all.

I need to reconfigure the queues on our small group and would like some advice of experts.

I would like users to be able to submit work with commands like:

$ qsub-l h_rt = 500 myscript.sub

and/or

$ qsub-memory hard-l = 30GB myscript.sub

so that the Planner can choose lineups and hosts within the configured queues limits and resources of the host.

Whereas the time limit works very well, I don't know how to implement the required memory...
I think I should set on a host also available memory and declare it as a consumable resource, but I don't know how to precede.

My queues would be something like:
-1h.q (wallclock time 1 hour)
-1d.q (wallclock duration 1 day)
-3d.q (wallclock time 3 days)
-2w.q (wallclock time 2 weeks or maybe nolimit..)

Queue configuration example:

# qconf - sq 1h.q
QName 1h.q
@1hour.hg parameter Listehotes
seq_no 0
load_thresholds np_load_avg = 1.75
suspend_thresholds NONE
nsuspend 1
suspend_interval 00:05:00
priority 0
min_cpu_interval 00:05:00
processors not DEFINED
BATCH, [node03.cluster = BATCH INTERACTIVE QTYPE],
[node25.cluster = BATCH INTERACTIVE]
ckpt_list NONE
pe_list make mpi orte smp
Run again FAKE
slots 8, [node03.cluster = 2], [node25.cluster = 2]
TMPDIR/tmp
shell/bin/csh
Prolog NONE
epilogue NONE
shell_start_mode posix_compliant
starter_method NONE
suspend_method NONE
resume_method NONE
terminate_method NONE
notify 00: 00:60
OWNER_LIST NONE
user_lists testers2.us
xuser_lists NONE
subordinate_list NONE
complex_values NONE
NONE projects
xprojects NONE
calendar NONE
default initial_state
s_rt INFINITY
h_rt 01:00
s_cpu INFINITY
h_cpu INFINITY
s_fsize INFINITY
h_fsize INFINITY
s_data INFINITY
h_data INFINITY
s_stack INFINITY
h_stack INFINITY
s_core INFINITY
h_core INFINITY
s_rss INFINITY
h_rss INFINITY
virtual_free INFINITY
h_vmem INFINITY


# qconf - shgrp @1day.hg
@1day.hg nom_du_groupe
setting Listehotes node04.cluster node05.cluster node06.cluster node07.cluster.
node11.cluster node12.cluster node16.cluster node20.cluster.
node21.cluster node22.cluster node26.cluster node27.cluster.
node28.cluster node29.cluster node30.cluster node31.cluster.
node32.cluster

All hint/advice will be welcome.

Thank you and best regards.
Robi

rnunnari wrote:

If it's good for you, your work in progress will be killed by the operating system, when it is more than 30 GB used then you can use the limit of resources h_vmem to the configuration of the queue.
The h_vmem requires the amount of virtual memory used by all running jobs. If the limit exceed, overconsuming work is killed.
The virtual_free is a soft limit and work will get a SIGXCPU signal that could be intercepted by the work.

In the case above, apart from ensuring that jobs don't take no more memory unless indicated, the Scheduler would also choose a host with any memory required for this task?

HM no you define this queue resource limits settings. for example. your host have a physical memory of 40GB and you want to keep some free memory, you can set the h_vmem to for example 30G resource_limit. Present 2 jobs, asking h_vmem = 30G will be scheduled to this host, but if the amount of memory usage of these two jobs reached the limit of 30G, a job will be killed.
The jobs are always planned, because the h_vmem is not a consumable.

>
>

To set up the EMS just to submit work to hosts that provide 30 GB, then you can install a complex variable and adding the complex_values to the configuration of the queue.

xuser_lists NONE
subordinate_list NONE
complex_values = 30GB memory
NONE projects
xprojects NONE
calendar NONE

Each task that demand memory-l = 30GB will be scheduled in this queue.

That's probably what I'm looking for... but:
(1) all the nodes in each single queue may have a different amount of memory


(2) the planner needs to know the amount of memory provided by each host
memory of l - 3) = 30 GB should be considered eligible any host that has at least this amount of memory
(4) that the memory must be a consumable resource so that if other tasks are running in a host, the Scheduler will examine the memory consumed by this job

Any comments/advice/help very welcome.

Thank you and best regards.
Robi

I think that in this case the complex variable preconfigured virtual_free might work for you.

qsub-l virtual_free = 30G

Presentation of jobs like this is just programmed to be host providing 30G of virtual memory, or also the mem_free, which shows just the physical memory.

Best regards
Marco

Tags: Oracle

Similar Questions

  • C7280 connected wireless is unable to print the test page is in the queue.

    I managed to install my C7280 wireless for my laptop but I can't seem to get anything to acually impression of the laptop.  However, I CAN print from the pc.  Whenever I try to print from the laptop, things simply to sit in the queue.

    To sum up my network; I have a desktop (Vista) connected to a router.  A laptop computer (XP) and the C7280 are connected wireless to the router.  I installed the base driver HP update listed on the Web site on the laptop.  I can ping the printer from the laptop, so I know that the two are properly connected to the router.

    I checked the port on the laptop to the printer, and it is directed to the IP address.  Everything gets a static IP address on my router, so I don't know its correct.  I printed out a page of the network printer, and it is configured on the IP of the right.

    Any ideas?

    Message edited by gatorman on 09/22/2009 10:15

    Well I never needed to dig into the router or the security of the software on the laptop.  Once I got the driver installed and stable (and that was not easy), all that was needed was a fresh printer.  I have reset the default printer and wiped my previous network settings.  Once I have manually reconfigure the network settings on the printer again, he started just feel by far.  A little strange behavior since no settings have been changed.  Anyway, problem solved.  You should consider adding this step in your process walkthroughs.

    Thanks for all the help.

  • don't print from firefox, file is automatically removed from the queue

    I try to print from the web browser firefox or a pdf document and files will not be not print and are removed from the queue after about 30 seconds. I tried the browser google chrome and they print well from there. This problem just started today.

    Make sure that you do not print in a file selected and the correct printer is selected. You can see these settings in the "native print dialog" window when you do {Ctrl + P}.

  • have the icon to download helper with video up, I have until it clicks, dosnt download or convert a number appears next to the icon and its listed in the queue draft.exe

    I was able to load videos 26 then he stopped down. I checked the preferences, the version is 4.9.24, I can see that the video is listed next to the icon, when I drag the mouse over it.

    I support download icon, when the video is running. I click next to the icon and choose the game I want, on fast download I see it loads, but no dwhelper. dosnt download or convert a number appears next to the icon and its listed in the queue draft.exe

    There is a problem with DownloadHelper Firefox 36. They are working on a new version, you can download and help test this discussion page:

    https://groups.Google.com/Forum/#! Forum/video-video downloadhelper-5

  • E HP Envy 7640 All-in-One-Sanchez: now, I have my documents stuck in the queue and I can get out. Help! I hate this printer...

    Whenever I change the paper (photo paper) when I get back to paper ordinary, it is immediately past offline or it gets stuck in the queue.  Now it is stuck in the queue.  Is it possible to get this printer to print without all these problems.  I am extremely illiterate on computers and this crazy.

    You helped me with "off connection" now can help you with this problem.  Thanks for the help, I really appreciate it.

    Hello @Sam141, greetings!

    Welcome to the HP support forums. I'd love to help you with your printing problems with your printer Envy 7640.

    I understand that you are a new user with this printer, that's why I suggest using an automated tool to correct this and many other common printer related issues.

    Go to http://hp.care/2bZ9w2q to download and install HP print and scan the doctor. This tool will be quickly and automatically perform several tasks resolution known problems for this problem. You can save this for future issues you can still.

    Please let me know if that solves the problem, or if you need assistance.

    See you soon

    Please click on 'acceptable' on the post that solves your problem to help others to find the solution. To show gratitude for my help, please click the 'Thumbs Up icon' below!

  • How to cancel print jobs in the queue? Model: HP Laserjet 3055

    I wanted to print a book of 200 pages of my laptop, so I pluged in the printer to the computer laptop and hurry to print on laptop. Then immediately decided not to print it, then I pressed cancel on the printer. But labour has not at all been cancelled. Whenever I try to print something it always starts with the work that I wanted to cancel initially. And on the laptop, the message block asking you if I want to add to the print queue.

    I would like to cancel the work that is placed into the queue of the printer for good, if someone can advise please help me, very desperate!

    Thank you

    Martine

    Hi John,.

    Open the Printers folder, and then double-click the printer. Click on the printer and then cancel all documents.

  • I'm unable to delete obsolete email addresses of mail. When I change a card email address Contacts outdated address appears at the top of the queue. Is it a problem of Contacts or a mail problem. How to solve this problem?

    I'm unable to delete obsolete email addresses of mail. When I change a card email address Contacts outdated address appears at the top of the queue. Is it a problem of Contacts or a mail problem. How to solve this problem?

    Have you tried to go to the recipients of mail/window/previous and delete e-mail addresses it?

  • Cannot clean up the queue and print the new document

    All of a sudden in trouble with my C6180 all-in-One. It didn't print a document remaining queues. Tried everything to clean up the queue. But nope. Document is in the list. Document status information: deletion. And never remove the ends. Right now my printer is not a printer. Can anyone help?

    Hello

    In Control Panel, open administrative tools and select abuse.  Scroll down to the print spooler service, right click and select Properties, then click the Stop button.  Now search for C:\Windows\System32\Spool\PRINTERS, then delete the tasks within this folder - you may need to click a command prompt to get the authority to open the PRINTERS folder.

    Restart the computer and you should find that the documents have been deleted.

    Kind regards

    DP - K

  • Re: How to reconfigure the remote control for Qosmio F50?

    Hello
    I have a Qosmio F50, which came with a standard remote control for applications like media library etc, how do I reconfigure the keys to do exactly what I want it to do?

    For example the button power on the remote control to completely stop the machine instead of standby

    Thank you
    Dan

    Hello Dan

    Why do you think something like this is possible? What is this described in s operating manuals.
    If something like this can be done, it must be described in the manuals?

    In 10 years Toshiba has offered several different notebooks with the remote, but something like this was never possible and remote control buttons were always with defined function.
    You have some really cool ideas.

  • HP8100 print job stuck in the queue

    I have a print job stuck in the queue of my HP Officejet Pro 8100.  I tried to delete the file, but it's been blocked for a day and I can't print anything else, it seems as if the job locked up in the queue stops other jobs.

    I did the following:

    tried to delete the file-will not remove status said "deletion" for more than a day.

    power cycle

    connection direct USB printer

    power cycle - unplug the power cable, the power button for 1 minute - leaving only machine for 30 minutes.

    Nothing has worked so far.

    Help, please.

    Thank you

    DITT

    Hello

    Try the following.

    From the desktop, hold down the Windows key and press R.  In the run window, type services.msc and press to enter.  Scroll down to the print spooler service, right click and select Properties, then click the Stop button.  Now search for C:\Windows\System32\Spool\PRINTERS, then delete the work inside this folder - you may need to click a command prompt to get the authority to open the PRINTERS folder.

    Restart the computer and you should find that the document has been deleted.

    Kind regards

    DP - K

  • HP Officejet Pro X476dw: Printer will print-elements are sitting in the queue, but the unit stops before printing

    The printer starts as it will print but then stops. The elements are sitting in the queue, so they are sent to the printer. I turned on and out and unplugged to reset. No error message. Connection to the local network.

    Hello

    Download and run the utility HP Print and Scan Dr. link below to solve the problem.

    www.HP.com/go/Tools

  • M127fw MFP: How to delete the print jobs in the queue?

    When I get an error message when trying to print, I keep trying to print.  This means that I can hit 'print' five times for the same document, because I hit 'print' whenever I think I might finally have something fixed.

    The problem is that HP never forget any of these applications - when it finally starts printing - it always prints every single job - meaning that I get multiple copies of jobs for which I got an error message.

    Where is the interface to view and delete these jobs? I can't find it on the printer itself.  Is there an interface where I can delete jobs in the queue?

    Go to devices and printers and double click on the printer icon. Now click on something like seeing what is printing a list of documents should appear and you can pass by and remove whatever ones you want.

  • Qosmio G40 - how to reconfigure the keys above the keyboard?

    Since the upgrade to Windows7, the buttons on the top of my G40 (TV, multimedia, Rec, Dolby, etc) don't work anymore. When I click on one, a pop-up window appears asking me to set up the button.

    Now, I've changed a single button to task wrong.

    (1) how can I change this back?
    (2) how can I get functions return when moving the cursor to the top of the screen (does not work either)

    THX

    Hello

    I think that you don t have to reconfigure the keys, you just need new version of Toshiba Value added Package which controls the multimedia keys.

    I checked the website of Toshiba Qosmio G40 and Windows 7 and there is a newer version that is compatible with Windows 7:
    http://EU.computers.Toshiba-Europe.com/innovation/download_drivers_bios.jsp

    It seems the newer version 1.2.40

    Check this box!

  • OfficeJet Pro 8600 Wireless Configuration - print is in the queue, then disappears. Do not print

    I just got the Officejet Pro 8600 as a gift and burden of implementing software and it on my wireless network.  When I try to print an e-mail or a coupon, the command changes to the printer and indicates in the queue. Then after a few seconds, the print queue (work) disappears without printing the document.  This command goes to the HP ePrint feature or the Officejet Pro 8600 network?  It shows the HP ePrint as being on USB.

    I have run all the Diagnostics, downloaded all the new software, software packages and updates.  I spend several hours trying to get to the printer.

    Thanks for any help you can provide.

    Hi @bksechols

    Welcome to the Forums of HP's Support.  I understand that when you send a print job to your printer Officejet 8600 to printing to the queue, then disappears without the printing of the print job.

    To help you, you please provide additional information?

    I look forward to hear from you.

  • Reconfigure the connection Wireless on Satellite M160

    My wireless seems to have gone wrong somehow. The computer will not pick up or connect to my network. Is there a way I can reconfigure the connection?

    Hello

    Of course, you can reconfigure the WLan settings.
    First of all, I would recommend resetting the router Wlan. Check the settings of WiFi, filtering by mac address, SSID name encryption.

    How have you tried to connect to the Wlan? Did you use the 3rd party Wlan client configuration tool (Intel, Atheros) or did you use the Wlan configuration option to own Windows?

    If you use a 3rd party client WLan configuration tool, then the windows own option should be disabled.
    I recommend to go through all the settings (encryption key, ssid) and please check if everything is good.

    By the way; Please don t forget to activate the wireless on your laptop network card ;)
    The switch on the side of the laptop must be turned on, and you should switch to WLan using FN + F8 key combination.

    Good bye

Maybe you are looking for

  • Toshiba Store Tv 1.5 - subtitles

    Hello everyone.I m new in this forum that I recently had a Toshiba Store Tv 1.5.First excuse my ignorance as Im not very in all technologies of this and everything, and my query may seem silly... I wonder how can I put subtitles for movies Im store i

  • Re: Buttons on Vista 64-bit of order Satellite A300-1ND multimedia

    Hello! My problem is this: I have a laptop Toshiba A300-1ND, and I installed a Windows Vista 64-bit on it. I installed all the drivers from the Toshiba support, including value added package page, which makes the key media work, I think. My problem i

  • Charset in html reports

    Hi all I'm currently building a VI that creates reports in html, using the report generation tools (LV2011). But the text in my reports contains non-English characters. I should the value of charset ISO-8859-9 by a meta tag in the head section of htm

  • How to add a NAS to libraries?

    original title: storage area network and libraries__ How to add a NAS to libraries? I tried some of the suggestions online, but none have worked so far. All proven methods?

  • Set the calendar of events to 'free '.

    Hey community! When you call the calendar to create a new calendar event, I use the following code , but now I want to add the function where the calendar event gets the value 'Free' and not 'busy '. Can someone help me here? Thank YOU in advance! ja