PB – Torsion benchmarks - Was comparing single points between AIMNET2, MACE, and xTB. Was comparing to reference geometries from CCSD. Seem to be wonky and errors are pretty high. (See plots from recording)
DC – I’d argue that benchmarks should be done with optimizations done using the same level of theory as the single points. But there I’d expect errors around 1kcal/mol, not the 10 that you’re seeing.
JW – Is this a random set of molecules, or are these the biggest outliers?
PB – This is a standard dihedral benchmark set.
JH – Did MACE look similar?
PB – Yes
DC – Where did you get this implementation?
PB – (ASE(ASC?), something about Kovacs lab)
…
PB – CCSD single points at the opt geos of MP2.
DC – So you’re basically doing the MACE calcs at the MP2 opts?
…
Â
JH – Is this dataset on QCA?
PB – Yes, will send info
SB – Have you tried minimizing with MACE? Does it go to a different conformer?
JH – Are they charged? MACE doesn’t handle charge
PB – Some are charged.
JH – But AIMNET2 should handle charge, so that doesn’t explain everything.
PB – I’ll coordinate with JH on this.