Liam Watts

Research Assistant

CSIRO•  December 2021 - Present

I'm working on the Data61 Language and Social Sciences team under the supervision of Sarvnaz Karimi and Maciej Rybinsky.Our team is researching how to improve Patient to Clinical Trial matching using Information Retrieval (IR) and NLP - I quickly learnt IR, then re-implemented the best base retrieval method from a Clinical Trial matching competition, improving upon it to create a 10x smaller model with similar effectiveness - I've developed machine learning engineering skills through training the 3 billion parameter T5 models on a computing cluster with Slurm, Pytorch Lightning and Deepspeed - I tested our in-house API and re-implemented several baseline methods with it as examples for a demonstration paper that will appear at SIGIR 2022. Code is available at https://github.com/csiromed/a2a-api-examples