Multimedia Signal Processing

Course Program

The first module of Multimedia Signal Processing (Fundamentals of Multimedia Signal Processing course) covers the fundamental tools for digital signal processing. In particular it addresses topics of signal analysis and filtering concerning audio and video data.

Some aspects of Statistical Signal Processing will also be presented during the course.

Participants will learn basic tools for digital signal filtering and analysis acquiring the knowledge to design specific filters and . In particular the program will be articulated in the following parts:

 

Review of Analog Signal Processing theory:

Some fundamentals of Analog Signal Processing will be recalled (sampling, quantization, Fourier Transform and Series, noise description...).

Introduction to Discrete Signals Transforms:

The z-transform, the Discrete Time Fourier Transform and the Discrete Fourier Transform will be described with their properties and application to filter design and analysis.

Introduction to Digital Filters:

This course part will cover Time-domain filter representations, transfer function analysis, frequency response analysis, Finite and Infinite impulse response implementation; stability analysis.

Windowing and Short Time Fourier Transform:

Overview of windows and real-time processing; overlap and add, overlap and save,  Short Time Fourier Transform for real time processing

Introduction to Multirate Processing:

Downsampling, upsampling, polyphase filters, perfect reconstruction filter banks.

Elements of Statistical Signal Processing:

Random sequences, properties and characterization. Spectral estimation, the Periodogram, linear prediction. Introduction to estimation theory, power spectral density, parametric and nonparametric spectral estimation. Autocorrelation and autocovariance methods.

 

Laboratory activities

Laboratory activities enable student to improve their understanding of the concepts learnt during the lectures.

The proposed examples of applications and exercises, cover audio, image and video processing, and are based on Matlab® and the related toolboxes (Digital Signal Processing System Toolbox, Audio System Toolbox, Image acquisition toolbox, Image Processing Toolbox ).

Examples of real-time processing with embedded devices (Raspberry Pi) and Simulink will also be provided.