Difference between revisions of "Daemons"

From UFRC
Jump to navigation Jump to search
Line 1: Line 1:
According to Wikipedia, a daemon "is a computer program that runs as a background process, rather than being under the direct control of an interactive user." ''[http://en.wikipedia.org/wiki/Daemon_%28computing%29 Reference]'' There are many uses for daemon tasks, from polling the batch system to collecting data from external sources. The features that unify these tasks are that they are long running (or regularly scheduled with cron) and that they have a small computational footprint (i.e. low average CPU and RAM usage).
 
  
It is against UF Research Computing [http://www.rc.ufl.edu/about/policies/jobs-and-processes/ policy] to run any interactive or long running process on the login nodes (gator.rc.ufl.edu servers) or the development servers (dev1 or dev2). To fill the need that users have to run these tasks, we have deployed a server dedicated to daemon tasks.
+
==Overview==
 +
The daemon server provides UF Research Computing users with the space and resources to run long-running processes that do not require a lot of computational power. Please remember that these types of processes cannot be run on the login servers and the walltime on the test servers is thirty minutes.
  
==Access to daemon server==
+
Daemon processes run in the background of a system rather than under the direct control of an interactive user. There are many uses for daemon tasks, from polling the batch system to collecting data from external sources. Daemon tasks are usually long-running or scheduled to run recurrently. They are also characterized by a small computational footprint (i.e., low average CPU and RAM usage). '''Daemon processes should not use 100% of a CPU for extended periods and such processes will be killed without warning.'''
  
Access to the daemon server is via ssh from one of the login servers for the cluster. For example, after connecting to gator.rc.ufl.edu, you can type:
+
==Access to the daemon server==
ssh daemon1
+
Connect to the cluster (gator.rc.ufl.edu) and use the ssh command to access the daemon server.
 +
<pre>ssh daemon1</pre>
  
The daemon server can also be access from your desktop by using SSH to connect to:
+
You can also connect directly to the daemon server from your SSH client. Instead of connecting to gator.rc.ufl.edu, connect to
 
+
<pre>daemon1.rc.ufl.edu</pre>
daemon1.rc.ufl.edu
 
  
 
==Running daemon processes==
 
==Running daemon processes==
Once connected to daemon1, you can start your daemon process and have it run in the background. Please note that as specified above, daemon processes use few resources&mdash;daemon processes that use 100% of a CPU for extended periods negatively impact the performance of this server for other users and will be killed without warning.
+
There are two ways to run a process in the background:
 
 
To run a process in the background, either add a & to the end of the command, e.g.
 
my.process.sh &
 
or start the process and once it is running, type control-Z and then bg to run it in the background.
 
 
 
==Setting up cron tasks==
 
  
To schedule a task to run regularly with cron, edit your crontab on the daemon1 node using:
+
1. Add an ampersand (&) to the end of the command
 +
<pre>my.process.sh &</pre>
  
crontab -e
+
2. Start the process and once it is running, type
 +
<pre>control-Z + b + g</pre>
  
There are several online resources for how to format a crontab file, but note that the configuration is specific to the server you are loged in on, so it is important to configure cron while logged into daemon1.
+
==Setting up recurring tasks with Cron==
 +
You can schedule a task to run recurrently with Cron, a time-based job scheduler by editing your crontab file on the daemon1 server. [[Cron | Click here for more detailed instructions.]]

Revision as of 14:22, 15 April 2015

Overview

The daemon server provides UF Research Computing users with the space and resources to run long-running processes that do not require a lot of computational power. Please remember that these types of processes cannot be run on the login servers and the walltime on the test servers is thirty minutes.

Daemon processes run in the background of a system rather than under the direct control of an interactive user. There are many uses for daemon tasks, from polling the batch system to collecting data from external sources. Daemon tasks are usually long-running or scheduled to run recurrently. They are also characterized by a small computational footprint (i.e., low average CPU and RAM usage). Daemon processes should not use 100% of a CPU for extended periods and such processes will be killed without warning.

Access to the daemon server

Connect to the cluster (gator.rc.ufl.edu) and use the ssh command to access the daemon server.

ssh daemon1

You can also connect directly to the daemon server from your SSH client. Instead of connecting to gator.rc.ufl.edu, connect to

daemon1.rc.ufl.edu

Running daemon processes

There are two ways to run a process in the background:

1. Add an ampersand (&) to the end of the command

my.process.sh &

2. Start the process and once it is running, type

control-Z + b + g

Setting up recurring tasks with Cron

You can schedule a task to run recurrently with Cron, a time-based job scheduler by editing your crontab file on the daemon1 server. Click here for more detailed instructions.