There is a hack we can do, but not sure if it’s sufficient
BP : will talk to Lori about this PR, see if this is something she is willing to hand off or if it’s basically finished
DD : we’ll loop back on this next week for path forward
Uploading datasets from private instance
Trevor
Would like to be able to submit dataset computed on private QCA instance to prod instance
BP: the export part of that is actually implemented; import part needs more work
TG: For bespoke workflow would be nice to have
JH: will definitely be helpful and is of interest in bespoke workflow
Benchmarking
Trevor + David
TG: is there benchmarking tooling that can help with batch processing on the QCPortal client?
BP: ideally the client already does this, but if it doesn’t, we’ll want it to
DD: should be able to support benchmarking needs for batch processing; Ben and I embarking on this in the next few months
TG: arbitrary lambda operations on data possible?
DD: would have to happen in the python layer on the server
perhaps submitted function could be dispatched to a worker process on the server, operations data local, then shipped by the server to client
TG: richer filtering would be a higher priority than the above
QCSubmit for automated FF coverage improvement
Josh
JH: Would be welcome to have this functionality included in QCSubmit
DD: would like everyone to to chew on what would be needed for the feedback loop of automated FF coverage gap identification, torsion prioritization, submission generation over the next week
JH: Is the feedback loop approach similar to something the ANI folks used (including automated dataset selection)? Isn’t this called “active learning”?
DD: I can reach out to Adrian Roitberg and friends for advice on their approach.
even if we partially achieve an autonomous (with human approval) feedback loop, we will have also improved much of our data access and benchmarking infrastructure to support the decision-making access patterns required
we already have large candidate datasets to draw samples from
we already have good submission automation tooling via QCSubmit
Add Comment