Difference between revisions of "MAS OS setup"

From MCEWiki
(mce.cfg)
 
(34 intermediate revisions by 2 users not shown)
Line 1: Line 1:
 +
{{Related|MAS}}
 
= Supported operating systems =
 
= Supported operating systems =
  
* Ubuntu 10.04, 9.10, 9.04, 8.10, 8.04, 7.10, 6.06.
+
We use Ubuntu.
* 10.04 is an LTS release.  Users should not expect support, in the near term, for Ubuntu releases newer than this.
 
  
= Ubuntu 10.04 =
+
* We only support LTS releases.  Currently, we support:
 +
** 18.04
 +
** 16.04
 +
** 14.04
 +
 
 +
= Ubuntu 16.04 and later =
 +
 
 +
The removal of the bigphysarea requirement from the kernel module means it's much easier to install MAS now.  Because you don't need to rebuild your kernel, it should be possible to simply checkout the MAS trunk.  Start by skipping down to the [[#Download (checkout) MAS and mce_script|Download (checkout) MAS and mce_script]] step, and then continue with installing MAS and MCE script.
 +
 
 +
= Ubuntu 14.04 =
  
 
The automated installation package is tested, but as Ubuntu tweaks its packages the install script may fall slightly out of sync.  It's worth a shot though.
 
The automated installation package is tested, but as Ubuntu tweaks its packages the install script may fall slightly out of sync.  It's worth a shot though.
  
After installing Ubuntu 10.04 (desktop), get the install tarball:
+
After installing Ubuntu 14.04, get the install tarball:
  
cd ~
+
  wget http://e-mode.phas.ubc.ca/mce/pc_install/install_tools/mce_install_ubuntu_14.04.tar.gz
  wget http://e-mode.phas.ubc.ca/~mhasse/mce/ubuntu_10.04/ubuntu_10.04_install.tar.gz
+
  tar -xzf ubuntu_14.04_install.tar.gz
  tar -xzf ubuntu_10.04_install.tar.gz
 
 
  cd install/
 
  cd install/
  
Line 19: Line 27:
 
From that install folder, run
 
From that install folder, run
 
  bash install.bash
 
  bash install.bash
 +
 +
It can't hurt to run this a couple of times to make sure all dependencies are resolved.
  
 
== Bigphysarea kernel patch ==
 
== Bigphysarea kernel patch ==
Line 28: Line 38:
 
or
 
or
 
  bash kernel_build.bash
 
  bash kernel_build.bash
 +
 +
Compiled kernels currently exist for the x64 architecture.
  
 
Then when one or the other of those has succeeded, install them:
 
Then when one or the other of those has succeeded, install them:
Line 34: Line 46:
 
You can now proceed to the section below titled "[[#Configure_the_system_for_MCE_users|Configure the system for MCE users]]".
 
You can now proceed to the section below titled "[[#Configure_the_system_for_MCE_users|Configure the system for MCE users]]".
  
 +
= Ubuntu 12.04 and earlier =
  
= Ubuntu 9.10 =
+
See [[MAS OS setup on obsolete systems]]
  
Starting with Ubuntu 9.10, some effort has been made to automate the installation.  After installing Ubuntu 9.10 (desktop), get the install tarball:
+
= Configure the system for MCE users =
 
 
cd ~
 
wget http://e-mode.phas.ubc.ca/~mhasse/mce/ubuntu_09.10/install.tar.gz
 
tar -xzf install.tar.gz
 
cd install/
 
 
 
== Install additional ubuntu packages ==
 
 
 
From that install folder, run
 
bash install.bash
 
 
 
== Bigphysarea kernel patch ==
 
 
 
You can either download the compiled kernels or build them from scratch.
 
 
 
From install folder, run EITHER
 
bash kernel_download.bash
 
or
 
bash kernel_build.bash
 
 
 
Then when one or the other of those has succeeded, install them:
 
bash kernel_install.bash
 
 
 
You can now proceed to the section below titled "[[#Configure_the_system_for_MCE_users|Configure the system for MCE users]]".
 
  
 +
== Setup environment for MCE user ==
  
= Ubuntu 6.06 - 9.04 =
+
We tend to assume that a single user and group will have dominion over the MCE software, scripts, and data. We often assume that this user will be called "mce".  But it doesn't need to be.  Even if multiple users are running things through their own accounts it is likely useful to have a single group that can be used to manage access to the data.
  
See [[MAS OS setup (Ubuntu 6.06 to 9.04)]]
+
Anyway, to set up a reasonable MCE user, see [[MAS user setup]].
  
= Configure the system for MCE users =
+
All users using the MCE will need to define some environment variables to use the scripts.  See the above link for lines to add to your '''.bashrc'''.
  
== Permissions and umask ==
+
== System umask ==
  
 +
You may want to set the system umask to make for a system where it's easier to share
 
Set the umask for all users to give write access for their group by default.
 
Set the umask for all users to give write access for their group by default.
  
Line 79: Line 70:
 
Edit /etc/login.defs and find the line that start "# UMASK" and change it to
 
Edit /etc/login.defs and find the line that start "# UMASK" and change it to
 
  UMASK          002
 
  UMASK          002
 
Any users wishing to use MCE under their own accounts should be added to the "mce" group and should have "mce" as their primary group.  Their umask must be set properly, or other users will not be free to manipulate shared files.
 
 
To setup additional system users, see the page on [[MAS user setup]].
 
  
 
== Folders ==
 
== Folders ==
  
This is the sort of thing that should be done by an install script...
+
mce_script assumes that /data/cryo/ exists and can be manipulated. To create something reasonable:
  
Data directory:
+
MCE_USER=mce
 +
MCE_GROUP=mce
 
  sudo mkdir /data
 
  sudo mkdir /data
  sudo chown mce:mce /data
+
  sudo chown $MCE_USER:$MCE_GROUP /data
 
  sudo chmod g+ws /data
 
  sudo chmod g+ws /data
 
  mkdir /data/cryo/
 
  mkdir /data/cryo/
  
Configuration directory:
 
sudo mkdir /etc/mce
 
sudo chgrp mce /etc/mce
 
sudo chmod g+ws /etc/mce
 
 
= If necessary, branch mce_script =
 
 
You can work with a complete checked-out tree, or not.
 
 
In the first case:
 
 
svn checkout svn://e-mode.phas.ubc.ca/mce_script
 
svn copy mce_script/trunk mce_script/branch/{your_project_name}
 
svn commit mce_script
 
 
Alternately, do the copy directly on the svn server (it is automatically committed):
 
svn copy svn://e-mode.phas.ubc.ca/mce_script/trunk svn://e-mode.phas.ubc.ca/mce_script/branch/{your_project_name}
 
 
There should be no need to branch MAS: just use trunk.
 
 
Then check out the appropriate branch (or the whole tree) on the new machine.
 
  
 
= Download (checkout) MAS and mce_script =
 
= Download (checkout) MAS and mce_script =
Line 124: Line 91:
 
The following procedure outlines the default situation, where MAS is being installed on a computer containing only one fibre card.  For information on running MAS with multiple fibre cards in one computer, see [[Multicard MAS]].
 
The following procedure outlines the default situation, where MAS is being installed on a computer containing only one fibre card.  For information on running MAS with multiple fibre cards in one computer, see [[Multicard MAS]].
  
== Install libconfig ==
+
== Makefile.svn ==
  
MAS uses libconfig to manage its configuration filesThe webpage is here: http://www.hyperrealm.com/libconfig/To install libconfig run the following:
+
MAS uses autoconf for some basic configuration stuffAfter checking out MAS from the SVN repository the ''first'' time, you need to bootstrap the autoconf process. To simplify this, the Makefile.svn file will automate the processFrom the MAS source folder run
  
   wget http://www.hyperrealm.com/libconfig/libconfig-1.3.2.tar.gz
+
   make -f Makefile.svn
  tar -xzf libconfig-1.3.2.tar.gz
 
  cd libconfig-1.3.2
 
  ./configure
 
  make
 
  sudo make install
 
  
To make the system aware of this library, add "/usr/local/lib" to /etc/ld.so.conf and run "sudo ldconfig"i.e.
+
If successful, this will create the "./configure" script. This step is only required on fresh check-outs of the repositoryIf you already have a ./configure script, even if it's out of date, you can skip this step. (After having been bootstrapped the
  echo /usr/local/lib | sudo tee -a /etc/ld.so.conf
+
first time, the build system is smart enough to know when it needs to regenerate itself.)
  sudo ldconfig
 
  
On newer systems (Ubuntu 7.10) you can do this instead:
+
Note: this procedure requires autoconf. If it's not installed, install it with:
  echo /usr/local/include | sudo tee /etc/ld.so.conf.d/libconfig.conf
+
 
   sudo ldconfig
+
   sudo apt-get install autoconf
  
 
== ./configure ==
 
== ./configure ==
  
MAS uses autoconf for some basic configuration stuff.  The biggest thing you usually need to tell it is what the basic username and group should be for mce data.  Also, there are a few options for the driver and some stupid python stuff.
+
Once the configure script exists, run it to generate the build system (ie. the Makefiles).  The biggest thing you usually need to tell it is what the basic username and group should be for mce data.  Also, there are a few options for the driver and some stupid python stuff.
  
 
From the MAS source folder, run
 
From the MAS source folder, run
Line 180: Line 141:
  
 
  make clean; make
 
  make clean; make
 +
 +
=== Troubleshooting ===
 +
Sometimes after doing an SVN update <code>make</code> doesn't work but instead returns the cryptic message:
 +
 +
*** No rule to make target `defaults/masdefault.m4', needed by `aclocal.m4'.
 +
 +
In this case, it's necessary to force a rebuild of the build system manually by running
 +
 +
make -f Makefile.svn
 +
./configure
 +
 +
See the [[#Makefile.svn|Makefile.svn section]] above for further details.
  
 
== Test the driver ==
 
== Test the driver ==
Line 189: Line 162:
  
 
This will load the driver, which should then try to talk to the SDSU PCI card if it is installed.  Note that since "reload" first unloads the driver if it is present, and then loads the driver from the current folder, it may report an "ERROR" message if the first step fails, even though the driver is successfully loaded.  The definitive way to check that the driver is loaded is
 
This will load the driver, which should then try to talk to the SDSU PCI card if it is installed.  Note that since "reload" first unloads the driver if it is present, and then loads the driver from the current folder, it may report an "ERROR" message if the first step fails, even though the driver is successfully loaded.  The definitive way to check that the driver is loaded is
   cat /proc/mce_dsp
+
   cat [[/proc/mce_dsp]]
  
 
If this file does not exist, the driver isn't loaded.  If the cat prints out a bunch of low-level driver information, you're in good shape.
 
If this file does not exist, the driver isn't loaded.  If the cat prints out a bunch of low-level driver information, you're in good shape.
Line 213: Line 186:
  
 
:The driver will automatically be set to load on boot.  To disable this, remove the symbolic link "/etc/rc2.d/S99mas".
 
:The driver will automatically be set to load on boot.  To disable this, remove the symbolic link "/etc/rc2.d/S99mas".
*install the hardware configuration file, <code>config2/mce.cfg</code>, and the MAS configuration file, <code>config2/mas.cfg</code> to <code>/etc/mce/</code>.
+
*install the hardware configuration file, <code>config2/mce.cfg</code>, and the MAS configuration file, <code>config2/mas.cfg</code> to <code>/etc/mce/</code>, assuming there aren't versions already there.
  
 
= Install mce_script =
 
= Install mce_script =
  
The mce_script files are designed so that users can fairly easily run a different set of scripts.  We will install a system default set in /usr/mce/mce_script
+
Users have the option of running the MCE scripts from an svn working copy, or of running the MCE scripts from an "installed" copyTalk to your MAS technician about which option is best for you.
 +
 
 +
== Running from an svn working copy ==
 +
 
 +
Checkout the tree directly into /usr/mce:
  
 
  cd /usr/mce
 
  cd /usr/mce
  svn checkout svn://e-mode.phas.ubc.ca/mce_script/branch/{your_experiment} mce_script
+
  svn checkout svn://e-mode.phas.ubc.ca/mce_script/trunk mce_script
  
Current experiments include ACT and SPIDER.
+
== Running from an installed copy ==
  
== mas_env.bash ==
+
Checkout the tree into your code folder; then make and install:
  
To set up the environment and path to use these scripts and idl codes, a user should do "source mas_env.bash". (This file used to live in mas/config, but has been moved into mce_script/template.)  Non-developer users can source /usr/mce/mce_script/template/mas_env.bash directly; advanced users may want to keep their own copy (or several different copies) in their home folder.
+
  cd code
 +
svn checkout svn://e-mode.phas.ubc.ca/mce_script/trunk mce_script
 +
make
 +
sudo make install
  
Note that MAS/mce_script scripts should *not* source mas_env.bash!  The whole point of it is that paths should be flexible.
 
  
 
== .bashrc ==
 
== .bashrc ==
  
To have bash start up with the MAS variables defined, and the paths ready, add the following lines to .bashrc :
+
Add a few lines to .bashrc to update your PATH, PYTHONPATH, and to define the MAS_* variables.  The new way, using [[mas_var]], is:
 +
eval `/usr/mce/bin/mas_var -e -s`
  
 +
The old way, which will probably still work for a while:
 +
 
  export MAS_ROOT=/usr/mce/mce_script/
 
  export MAS_ROOT=/usr/mce/mce_script/
 
  source $MAS_ROOT/template/mas_env.bash
 
  source $MAS_ROOT/template/mas_env.bash
 
  export IDL_PATH="<IDL_DEFAULT>:$MAS_IDL/mas"
 
  export IDL_PATH="<IDL_DEFAULT>:$MAS_IDL/mas"
  
While you're in there, you may want to define a few aliasesIn particular, I always uncomment the alias ll='ls-l' line.
+
== Configuration data ==
 +
 
 +
Example configuration files (especially [[experiment.cfg]]) are kept in mce_script/template.  MAS, by default, expects user configuration data to be in /usr/mce/config.  Users should copy the template/ files to /usr/mce/config/, and then make configuration adjustmentsAfter install mce_script, you can copy the template config from it with:
 +
 
 +
sudo cp -r /usr/mce/mce_script/template /usr/mce/config
 +
sudo chown -R mce /usr/mce/config
 +
 
 +
[[Category:MAS]]

Latest revision as of 15:05, 26 September 2019

Related topics:

Supported operating systems

We use Ubuntu.

  • We only support LTS releases. Currently, we support:
    • 18.04
    • 16.04
    • 14.04

Ubuntu 16.04 and later

The removal of the bigphysarea requirement from the kernel module means it's much easier to install MAS now. Because you don't need to rebuild your kernel, it should be possible to simply checkout the MAS trunk. Start by skipping down to the Download (checkout) MAS and mce_script step, and then continue with installing MAS and MCE script.

Ubuntu 14.04

The automated installation package is tested, but as Ubuntu tweaks its packages the install script may fall slightly out of sync. It's worth a shot though.

After installing Ubuntu 14.04, get the install tarball:

wget http://e-mode.phas.ubc.ca/mce/pc_install/install_tools/mce_install_ubuntu_14.04.tar.gz
tar -xzf ubuntu_14.04_install.tar.gz
cd install/

Install additional ubuntu packages

From that install folder, run

bash install.bash

It can't hurt to run this a couple of times to make sure all dependencies are resolved.

Bigphysarea kernel patch

You can either download the compiled kernels or build them from scratch.

From install folder, run EITHER

bash kernel_download.bash

or

bash kernel_build.bash

Compiled kernels currently exist for the x64 architecture.

Then when one or the other of those has succeeded, install them:

bash kernel_install.bash

You can now proceed to the section below titled "Configure the system for MCE users".

Ubuntu 12.04 and earlier

See MAS OS setup on obsolete systems

Configure the system for MCE users

Setup environment for MCE user

We tend to assume that a single user and group will have dominion over the MCE software, scripts, and data. We often assume that this user will be called "mce". But it doesn't need to be. Even if multiple users are running things through their own accounts it is likely useful to have a single group that can be used to manage access to the data.

Anyway, to set up a reasonable MCE user, see MAS user setup.

All users using the MCE will need to define some environment variables to use the scripts. See the above link for lines to add to your .bashrc.

System umask

You may want to set the system umask to make for a system where it's easier to share Set the umask for all users to give write access for their group by default.

Edit /etc/profile and change the "umask 022" line to

umask 002

Edit /etc/login.defs and find the line that start "# UMASK" and change it to

UMASK           002

Folders

mce_script assumes that /data/cryo/ exists and can be manipulated. To create something reasonable:

MCE_USER=mce
MCE_GROUP=mce
sudo mkdir /data
sudo chown $MCE_USER:$MCE_GROUP /data
sudo chmod g+ws /data
mkdir /data/cryo/


Download (checkout) MAS and mce_script

See MAS svn repository.

Compile and install MAS

The following procedure outlines the default situation, where MAS is being installed on a computer containing only one fibre card. For information on running MAS with multiple fibre cards in one computer, see Multicard MAS.

Makefile.svn

MAS uses autoconf for some basic configuration stuff. After checking out MAS from the SVN repository the first time, you need to bootstrap the autoconf process. To simplify this, the Makefile.svn file will automate the process. From the MAS source folder run

 make -f Makefile.svn

If successful, this will create the "./configure" script. This step is only required on fresh check-outs of the repository. If you already have a ./configure script, even if it's out of date, you can skip this step. (After having been bootstrapped the first time, the build system is smart enough to know when it needs to regenerate itself.)

Note: this procedure requires autoconf. If it's not installed, install it with:

 sudo apt-get install autoconf

./configure

Once the configure script exists, run it to generate the build system (ie. the Makefiles). The biggest thing you usually need to tell it is what the basic username and group should be for mce data. Also, there are a few options for the driver and some stupid python stuff.

From the MAS source folder, run

./configure

Some useful options:

 --disable-driver        suppress driver compilation/installation
 --disable-bigphysarea   compile driver without bigphysarea support
 --disable-config2       suppress mas.cfg and mce.cfg generation/installation
 --enable-multicard      build a version of MAS which can drive multiple fibre cards.  (See Multicard MAS for specifics.)
 --with-user=USER        set default MCE user
 --with-group=GROUP      set default MCE group
 --with-kernel-dir=DIR   set kernel build directory (typically automatically determined)

Run

./configure --help

for a full list. When running, configure will complain if it cannot find something, and even suggest what package you need to install.

mce.cfg

After running configure, but before running make, you must specify a template file (mce.cin) which will be used to generate the hardware configuration file (mce.cfg). Full details of this procedure are given in the mce.cfg page, but briefly:

  1. copy an appropriate template from config2/templates to config2/mce.cin
  2. edit the config2/mce.cin file to describe your MCE.

The configuration file will be installed automatically when make install is run below. This entire step can be skipped if you passed --disable-config2 to configure above, but note that MAS will not function without mce.cfg and mas.cfg installed.

make

This often works.

make clean; make

Troubleshooting

Sometimes after doing an SVN update make doesn't work but instead returns the cryptic message:

*** No rule to make target `defaults/masdefault.m4', needed by `aclocal.m4'.

In this case, it's necessary to force a rebuild of the build system manually by running

make -f Makefile.svn
./configure

See the Makefile.svn section above for further details.

Test the driver

It is wise to test that the driver does not kill your machine before installing it to load on boot. After compiling do:

cd driver
sudo ./reload

This will load the driver, which should then try to talk to the SDSU PCI card if it is installed. Note that since "reload" first unloads the driver if it is present, and then loads the driver from the current folder, it may report an "ERROR" message if the first step fails, even though the driver is successfully loaded. The definitive way to check that the driver is loaded is

 cat /proc/mce_dsp

If this file does not exist, the driver isn't loaded. If the cat prints out a bunch of low-level driver information, you're in good shape.

sudo make install

If you're satisfied that the driver works, install the whole thing. Go back up to the MAS base folder and run

sudo make install

This will do the following:

  • install the kernel driver, driver/mce_dsp.ko, into /lib/modules/$(uname -r)/kernel/drivers/misc/, and re-scan the module dependencies.
  • install the MAS binaries from applications/ and the scripts from script/ into /usr/mce/bin
  • install the MAS udev ruleset scripts/91-mas.rules into /etc/udev/rules.d/. These udev rules will ensure that the mce_dsp module is loaded and the MAS device nodes are created at boot time. You can get udev to run these rules immediately, which will result in /dev being populated with the mce devices, by running:
 sudo udevadm trigger
or, else, you can make the nodes yourself by running mas_mknodes.
  • install the mas logging daemon script /etc/init.d/mas init script. The driver can then be started/restarted as desired through this script:
/etc/init.d/mas restart
The driver will automatically be set to load on boot. To disable this, remove the symbolic link "/etc/rc2.d/S99mas".
  • install the hardware configuration file, config2/mce.cfg, and the MAS configuration file, config2/mas.cfg to /etc/mce/, assuming there aren't versions already there.

Install mce_script

Users have the option of running the MCE scripts from an svn working copy, or of running the MCE scripts from an "installed" copy. Talk to your MAS technician about which option is best for you.

Running from an svn working copy

Checkout the tree directly into /usr/mce:

cd /usr/mce
svn checkout svn://e-mode.phas.ubc.ca/mce_script/trunk mce_script

Running from an installed copy

Checkout the tree into your code folder; then make and install:

cd code
svn checkout svn://e-mode.phas.ubc.ca/mce_script/trunk mce_script
make
sudo make install


.bashrc

Add a few lines to .bashrc to update your PATH, PYTHONPATH, and to define the MAS_* variables. The new way, using mas_var, is:

eval `/usr/mce/bin/mas_var -e -s`

The old way, which will probably still work for a while:

export MAS_ROOT=/usr/mce/mce_script/
source $MAS_ROOT/template/mas_env.bash
export IDL_PATH="<IDL_DEFAULT>:$MAS_IDL/mas"

Configuration data

Example configuration files (especially experiment.cfg) are kept in mce_script/template. MAS, by default, expects user configuration data to be in /usr/mce/config. Users should copy the template/ files to /usr/mce/config/, and then make configuration adjustments. After install mce_script, you can copy the template config from it with:

sudo cp -r /usr/mce/mce_script/template /usr/mce/config
sudo chown -R mce /usr/mce/config