Don't miss the NLP Summit 2022, free and online event in October 4-6. Register for freehere.
was successfully added to your cart.

Linguistically informed NLP for healthcare experience data

Investigation of attention mechanisms of BERT and other language models – neural and otherwise – have found that these models are often, to one degree or another, implicitly learning details of syntactic structure and other linguistic features in the performance of various natural language processing tasks (Clark et al. 2019, Goldberg 2019, Shi et al. 2016, inter alia).

While this might be heartening news to linguists, it raises the questions of whether these frameworks might be partially reinventing the wheel with respect to the scientific knowledge of language, and also of what further linguistic structures and phenomena might be exploited to supplement the statistical models.

In this talk, I discuss various ways of leveraging linguistic structure to improve and expand NLP performance, particularly in a pipeline architecture, with a focus on experience data in the healthcare domain.

Applying off-the-shelf NLP in healthcare? More dangerous than you think

Transformers have come to define what NLP means in 2021. Not only are these black-box decision-makers, but also interpret the free-text in...