Mila technical documentation

Welcome to Mila’s technical documentation. See contents below.

Introduction

• Purpose of this documentation
  • Intended audience
• Contributing

General theory

• What is a computer cluster?
• Parts of a computing cluster
  • The login nodes
  • The compute nodes
  • The storage nodes
  • Different nodes for different uses
• UNIX
• The batch scheduler
  • Slurm
• Processing data
  • Data parallelism
  • Model parallelism
  • Communication concerns
  • Filesystem concerns
• Software on the cluster
  • Cluster software modules
  • Containers
  • Python Virtual environments

Systems and services

• Computing infrastructure and policies
  • Roles and authorizations
  • Overview of available computing resources at Mila
  • Node profile description
  • Data sharing policies
  • Monitoring
  • Storage
  • Data Transmission
• Computational resources outside of Mila
  • Compute Canada Clusters
  • Access to exceptionally large computation capacity

How-tos and Guides

• Getting started
  • Connect to the cluster
  • Compute nodes
  • Interactive job
  • Getting stuff to/from the cluster
  • Running a script
  • Batch job
• User’s guide
  • Logging in to the cluster
  • Running your code
  • Portability concerns and solutions
  • Singularity
  • Contributing datasets
  • Data Transmission using Globus Connect Personal
  • JupyterHub
  • Advanced SLURM usage and Multiple GPU jobs
  • Frequently asked questions (FAQs)
• AI tooling and methodology handbook

Extras

• Audio and video resources at Mila
• Who, what, where is IDT
  • IDT’s mission
  • The IDT team

Support

To reach the Mila infrastructure support, please file a ticket at https://it-support.mila.quebec/

Contribution

If you find any errors in the documentation, missing or unclear sections, or would simply like to contribute, please open an issue or make a pull request on the github page.