With the dramatic growth of the image data on the web, there is an increasing demand of the algorithms capable of understanding the visual information automatically.

This thesis mainly focuses on multimodal understanding and Visual Question Answering (VQA) via deep learning methods. For technical contributions, this thesis first focuses on improving multimodal fusion schemes via multi-stage vision-language interactions.

This thesis mainly focuses on cross-modal retrieval and single-modal image retrieval via deep learning methods, i.e. by using deep convolutional neural networks.

In 2018, the number of mobile phone users will reach about 4.9 billion. Assuming an average of 5 photos taken per day using the built-in cameras would result in about 9 trillion photos annually.

Tomography is a powerful technique to non-destructively determine the interior structure of an object.Usually, a series of projection images (e.g.\ X-ray images) is acquired from a range of different positions.

The invention of neural networks marks a critical milestone in the pursuit of true artificial intelligence. Despite their impressive performance on various tasks, these networks face limitations in learning efficiently as they are often trained from scratch.

In deep reinforcement learning, searching and learning techniques are two important components. They can be used independently and in combination to deal with different problems in AI, and have achieved impressive results in game playing and robotics. These results have inspired research into artificial…

Implementation of the new sound synthesis and analysis method in music composition.

Sewer pipes are an essential infrastructure in modern society and their proper operation is important for public health. To keep sewer pipes operational as much as possible, periodical inspections for defects are performed.

In this thesis we explore machine and deep learning approaches that address keychallenges in high dimensional problem areas and also in improving accuracy in wellknown problems. In high dimensional contexts, we have focused on computational fluid dynamics (CFD) simulations.

Radiography is an important technique to inspect objects, with applications in airports and hospitals. X-ray imaging is also essential in industry, for instance in food safety checks for the presence of foreign objects.

Over several decades, a variety of computational methods for drug discovery have been proposed and applied in practice. With the accumulation of data and the development of machine learning methods, computational drug design methods have gradually shifted to a new paradigm, i.e. deep learning methods…

How did Google’s computer programme AlphaGo become so good at board game Go that it could defeat the world champion? On June 29, developer Aja Huang will speak about this during a lecture in the Gorlaeus building.

How did Google's computer programme AlphaGo become so powerful? On June 29, developer Aja Huang elaborated on this during a lecture in the Gorlaeus building.

Optical projection tomography (OPT) is a tomographic 3D imaging technique used for specimens in the millimetre scale.