University of Oxford Courses

From Poverty to Prosperity: Understanding Economic Development

5

How can poor societies become prosperous and overcome obstacles to do so? Professor Sir Paul Collier is one of the world's leading scholars on this question, and in this economics course you will have the opportunity to learn from him directly.This course will discuss and examine the following topics:The role of government and the key political, social and economic processes that affect development;Why societies need polities that are both centralised and inclusive, and the process by which these polities develop;The social factors that are necessary for development, including the importance of identities, norms, and narratives;The impact of economic processes on development, including discussion about how government policies can either promote or inhibit the exploitation of scale and specialisation;The external conditions for development, including trade flows, capital flows, labour flows and international rules for governance.Enrol in this course to understand the factors that influence economic development and the different development paths that countries across the world have taken.

Deep Learning for Natural Language Processing

5

This is an advanced course on natural language processing. Automatically processing natural language inputs and producing language outputs is a key component of Artificial General Intelligence. The ambiguities and noise inherent in human communication render traditional symbolic AI techniques ineffective for representing and analysing language data. Recently statistical techniques based on neural networks have achieved a number of remarkable successes in natural language processing leading to a great deal of commercial and academic interest in the fieldThis will be an applied course focussing on recent advances in analysing and generating speech and text using recurrent neural networks. We will introduce the mathematical definitions of the relevant machine learning models and derive their associated optimisation algorithms. The course will cover a range of applications of neural networks in NLP including analysing latent dimensions in text, transcribing speech to text, translating between languages, and answering questions. These topics will be organised into three high level themes forming a progression from understanding the use of neural networks for sequential language modelling, to understanding their use as conditional language models for transduction tasks, and finally to approaches employing these techniques in combination with other mechanisms for advanced applications. Throughout the course the practical implementation of such models on CPU and GPU hardware will also be discussed.This course will be lead by Phil Blunsom and delivered in partnership with the DeepMind Natural Language Research Group. Example lecturers include:Phil Blunsom (Oxford University and DeepMind)Chris Dyer (Carnegie Mellon University and DeepMind)Edward Grefenstette (DeepMind)Karl Moritz Hermann (DeepMind)Andrew Senior (DeepMind)Wang Ling (DeepMind)Jeremy Appleyard (NVIDIA)Learning outcomesAfter studying this course, students will:Understand the definition of a range of neural network models;Be able to derive and implement optimisation algorithms for these modelsUnderstand neural implementations of attention mechanisms and sequence embedding models and how these modular components can be combined to build state of the art NLP systems.Have an awareness of the hardware issues inherent in implementing scalable neural network models for language data.Be able to implement and evaluate common neural network models for language.PrerequisitesThis course will make use of a range of basic concepts from Probability, Linear Algebra, and Continuous Mathematics. Students should have a good knowledge of basic Machine Learning, either from an introductory course or practical experience. No prior linguistic knowledge will be assumed. The course will contain a significant practical component and it will be assumed that participants are proficient programmers.SynopsisThis course will cover a subset of the following topics:Introduction/Conclusion: Why neural networks for language and how this course fits into the wider fields of Natural Language Processing, Computational Linguistics, and Machine Learning.Simple Recurrent Neural Networks: model definition; the backpropagation through time optimisation algorithm; small scale language modelling and text embedding.Advanced Recurrent Neural Networks: Long Short Term Memory and Gated Recurrent Units; large scale language modeling, open vocabulary language modelling and morphology.Scale: minibatching and GPU implementation issues.Speech Recognition: Neural Networks for acoustic modelling and end-to-end speech models.Sequence to Sequence Models: Generating from an embedding; attention mechanisms; Machine Translation; Image Caption generation.Question Answering: QA tasks and paradigms; neural attention mechanisms and Memory Networks for QA. Advanced Memory: Neural Turing Machine, Stacks and other structures.Linguistic models: syntactic and seminatic parsing with recurrent networks.SyllabusRecurrent Neural Networks, Backpropagation Through Time, Long Short Term Memory, Attention Networks, Memory Networks, Neural Turing Machines, Machine Translation, Question Answering, Speech Recognition, Syntactic and Semantic Parsing, GPU optimisation for Neural NetworksReading listAs the material covered in this course is based on recent research results there is not a relevant textbook for the area. The readings for the course will thus be based on published papers and online material. 

Cognitive Behavioural Skills to Treat Back Pain: The Back Skills Training (BeST) Programme

5

Understand a cognitive behavioural approach to manage ongoing low back painThe Back Skills Training (BeST) programme focuses on ‘undoing’ beliefs about low back pain, and provides skills to become more active, despite pain. The programme was developed by experts in psychology, physiotherapy, cognitive-behavioural therapy, and people with long-standing low back pain. According to a rigorous clinical trial, the BeST programme produces long term reductions in people’s pain and disability and is a very cost effective treatment.On this course you will explore the BeST programme, examining the causes of persistent low back pain, and the cognitive behavioural approach.This course is approved by the British Psychological Society for the purposes of Continuing Professional Development for healthcare professionals. It is an unfacilitated course designed for healthcare professionals with a role or interest in managing patients with low back pain (including nurses, occupational therapists, physiotherapists and psychological therapists).It will also be useful for students training to become healthcare professionals. The Certificate of Achievement for this course would be useful for providing evidence of CPD.