Deployment Procedure

This document is designed to help you set up an OpenFF QM+MM benchmark using your own set of molecules.

If you experience any issues during any stage of the procedure, please raise issues here. You can also receive support on the Open Force Field Slack channel benchmarks-support NOTE: all discussions are public, so please do not disclose any molecule information you wish to remain private.

 

Installation using conda

conda environments have been created which are fully self-consistent and contain at a minimum all of the required dependencies to run the calculations and generate the final analysis.

Create a new conda environment on any machines that will hold your local QCFractal server or run compute managers using the command:

conda env create openforcefield/openff-benchmark-optimization

Activate the environment using:

conda activate openff-benchmark-optimization

Any update to the workflow will be distributed via an update to this environment.

Software Updates

Whenever we need to update any of the software with bug fixes or improvements we will update the conda environment above. To install these updates it is recommended that you remove the current working environment with conda env remove -n openff-benchmark-optimization and install again using the instructions above.

Installation using a single-file installer

If your compute environment cannot reach Anaconda Cloud, you can install the conda environment via a single-file installer.

  1. Navigate to the Releases page for openff-benchmark.

  2. For the most recent release in the list, click on the Assets dropdown, and download the ubuntu-latest_py3.7.sh.zip file. This is ~1GB, so the download may take a moment.

  3. Upload the file to your compute environment/cluster.

  4. Unzip with unzip ubuntu-latest_py3.7.sh.zip.

  5. Run the installer with: bash openff-benchmark-*/openff-benchmark-*.sh -b -p openff-benchmark-miniconda, substituting the name of the unzipped directory and the install script.

  6. Add conda executable to your environment with source openff-benchmark-miniconda/etc/profile.d/conda.sh

  7. Activate the base environment with conda activate. This will be the name of your environment instead of openff-benchmark-optimization, which you will see used elsewhere.

To make it easy to load this environment at will, we recommend you create an openff-benchmark-optimization.sh file with the following contents:

source openff-benchmark-miniconda/etc/profile.d/conda.sh conda activate

Software Updates

If you used the single-file installer approach, you will need to remove or rename the openff-benchmark-miniconda directory created from installation and repeat the install instructions above.

Compute Approaches

Multiple compute options have been created to allow users to generate the QM and MM optimizations required for the benchmark. The main difference between these is the use of a long-running self-hosted QCFractal server instance to store and collect all data during the benchmark.

If you have have chosen a compute option that requires a self-hosted QCFractal server instance, follow the instructions below.

Setting up a QCFractal Server

In order to be able to use a local QCFractal server instance, you will need to be able to host the instance on a machine with a port (e.g. 7777) that is network-accessible from either the head node or compute nodes of your cluster. In the case where you do not have access to an HPC cluster and are using a single machine to host the server and perform compute, all network communication will occur in-host via localhost.

There are several benefits to using a self-hosted server:

  1. There is a long-running database of results which can be queried at any time during execution for progress.

  2. QCFractal will automatically handle the parallelization and distribution of all tasks between connected managers.

  3. Error reporting is more verbose as it is captured into the database on failed tasks.

Server setup

Initialize your server instance with:

See qcfractal-server init --help for additional options. This will by default place the server data in ~/.qca/qcfractal.

Start up the server instance with:

See qcfractal-server start --help for additional options.

Manager setup

We will submit molecules and computation requests to the server, but compute of those computation requests must be performed by one or more QCFractal manager(s) that can communicate with that server.

Generally, you can start a manager with:

The content of your manager’s config.yaml, as well as whether you will launch it as a long-running process or as part of a batch job, depends on your cluster setup and the compute option you have chosen to use on it.

Troubleshooting

  • Where is the local QCArchive database stored

    • you can find the database in a path like ~/.qca/qcfractal/ on the machine where you activated the server.

  • Why do I see stereochemistry issues in the initial step in the workflow?

    • All file reading and writing is done via the Open Force Field Toolkit, with many cheminformatics operations powered by RDKit. When we read in a molecule we check with RDKit if the molecule has any missing stereochemistry information or for other common formatting issues. We recommend using 3D SDF files where possible so that all stereochemistry is fully defined.

  • Missing molecules?

    • In each stage of the workflow, a small fraction of molecules will encounter issues with the various programs in the pipeline. When this happens a warning is shown, and the molecule is moved to an error subdirectory of the output folder.

    • During the analysis, you may notice some molecules are missing or the number of conformers of the molecule is not as expected. During optimization, we sometimes see proton transfer and the resulting optimized geometry is actually a tautomer of the input. In this case, the optimization is excluded from the analysis. This should not affect the results.