MASTER THESIS: AUDIO BASED ACTIVITY DETECTION

Motivation:

Currently, homes and buildings around us become smart and more than ever connected to us and our devices. A plethora of sensors enables us to detect events in our environment. There are sensors to detect temperature, smoke or general movement. Especially the latter – the detection of movements – is in most cases related to sound of some sorts: opening of windows and doors, breaking of glass or many more. Each one of these events produces a more or less common pattern of sounds. The abstraction of these events by their sound patterns is the core of this project.
One of our missions with this project is to make the sensing of events cheaper and therefore more broadly available. We have high ambitions to develop hardware enabled connected home services that ease our daily personal and business lives. During this thesis a prototype for processing audio signals and pattern matching to detect certain activities should be developed and integrated into the Smart Energy Living Lab at fortiss.
Since the recognition of a lot of different sound patterns is a very complex target, at the first stage generic activities need to be recorded and classified. Hereinafter the interesting patterns are subjected to a more detailed analysis, to draw conclusions about the specific activities (computer work, house work, eating, etc.) or context information (number of persons, ongoing presentation, conference call, etc.). The goal is to utilize the background noise (non-speech) for assumptions about certain activities and develop a concept and prototype of an audio based activity detection component. This component will be integrated into the SMG2.0 middleware for a self-balancing smart grid node. Based on the requirement analysis with an partner from industry, 3-5 use cases will be implemented and evaluated.
Tasks:
– Analyse and evaluate related work in the domains of audio processing and acoustic activity detection
– Development of different scenarios and requirements elicitation
– Development of a generic concept for audio (only) based activity detection
– Priorisation of use cases
– Implementation of the proposed concept as a SMG2.0 component (a part of the existing Smart Energy Living Lab demonstrator)
– Statistical/Practical Evaluation (e.g. false positive and false negative rates) of the proposed solution
Compulsory qualifications:
– Work independently
– Enjoy working in teams
– Experience in Java and the Eclipse platform
– Beneficial: Experiences in
o Audio processing, feature extraction
o Machine learning (e.g. Tensorflow), anomaly detection and classification
General Conditions:
Date: from now
Duration: 4 – 6 Month
Supervisor: PD Dr. Bernhard Schätz
Advisors: Markus Duchon, Patrick Löchelt (thiinc GmbH), Till Klocke (thiinc GmbH)

If we have aroused your interest, send your application to career (at) fortiss.org. Please note that applications without this code cannot be considered!
Application code: FB1-NOP-BAM-02-2016
Contact Person: Markus Duchon

Master Thesis: A Framework for Fault Detection and Identification for Smart Energy Systems in Office Environments

Motivation:

A reliable and robust smart energy system should also have features to isolate and identify faults by observing the behavior of components, actuators and sensors. The fortiss smart energy demonstrator operating in the fortiss office environment is a middleware, which monitors and controls (smart) devices (e.g. light switches, electric plugs etc.).

In the absence of such feature, the presence of a fault is detected only when a component-level or system-level failure occurs, which leads to total disruption of the system. For instance, a potential fault is indicated by the registration of a light-switch signal but the lack of increase in power consumption or the lack of increase in measured brightness. At the same time, a coincidental increase in brightness but a lack of increase in power consumption can be an indication of a defect in the power meter.

Objective:

The goal of this thesis is to extend an existing component that checks the running status of different components in the demonstrator. A framework will be developed to detect and identify the software faults with in the demonstrator using the model-based fault detection and Identification techniques.

Tasks:

  • An in-depth literature survey on model-based Fault Detection and Identification (FDI) techniques.
  • Development of use cases, design and requirement identification within the scope of the demonstrator.
  • Creation of a FDI framework and implementation of the framework into the fortiss smart energy demonstrator.
  • Evaluation of the framework according to the requirements and suitability of the approach w.r.t the Service Oriented Architecture-based distributed systems.

 Prerequisites:

  • Good knowledge of Java
  • Automata and logic theory knowledge
  • Knowledge of matlab/simulink

Contact and Information: Pragya Kirti Gupta, Markus Duchon,  Bernhard Schätz