Menu

PROJECT OVERVIEW

Holistic Integration of Emerging Supercomputing Technologies (Hi-EST) is a 5-year project funded by an ERC Starting Grant (GA 639595) awarded to Dr. David Carrera. HiEST involves research in Adaptive Learning Algorithms, Task Placement and Scheduling Algorithms, Data Placement Strategies and Software Defined Environments, and has the objective to maximize positive synergies between current research activities in the Computer Sciences Department at BSC.
Hi-EST aims to address a new class of the placement problem, a challenge for computational sciences that consists in mapping workloads on top of hardware resources with the goal to maximise the performance of workloads and the utilization of resources. The objective of the placement problem is to perform a more efficient management of the computing infrastructure by continuously adjusting the number and type of resources allocated to each workload.


News & Publications

Research Topics

Hi-EST aims to address a new class of the placement problem, a challenge for computational sciences that consists in mapping workloads on top of hardware resources with the goal to maximise the performance of workloads and the utilization of resources. The objective of the placement problem is to perform a more efficient management of the computing infrastructure by continuously adjusting the number and type of resources allocated to each workload.
Placement, in this context, is well known for being NP-hard, and resembles the multi-dimensional knapsack problem. Heuristics have been used in the past for different domains, providing vertical solutions that cannot be generalised. When the workload mix is heterogeneous and the infrastructure hybrid, the problem becomes even more challenging. This is the problem that Hi-EST plans to address. The approach followed will build on top of four research pillars: supervised learning of the placement properties, placement algorithms for tasks, placement algorithms for data, and software defined environments for placement enforcement.
Hi-EST plans to advance research frontiers in four different areas:

  1. Adaptive Learning Algorithms: by proposing a novel use of Deep Learning techniques for guiding task and data placement decisions;
  2. Task Placement: by proposing novel algorithms to map heterogeneous sets of tasks on top of systems enabled with Active Storage capabilities, and by extending unifying performance models for heterogeneous workloads to cover and unprecedented number of workload types;
  3. Data Placement: by proposing novel algorithms to map data on top of heterogeneous sets of key/value stores connected to Active Storage technologies; and
  4. Software Defined Environments (SDE): by extending SDE description languages with a still inexistent vocabulary to describe Supercomputing workloads that will be leveraged to combine data and task placement into one single decision-making process.

Research Team


PRINCIPAL INVESTIGATOR

David Carrera

Senior Researcher


POST-DOC RESEARCHERS

Jordà Polo

Post-Doc Researcher

Josep Ll. Berral

Post-Doc Researcher


PHD STUDENTS

David Buchaca

PhD Student

Nicola Cadenelli

PhD Student

EXEMPLE

Open Position

PhD Student


SUPPORT STAFF

EXEMPLE

Open Position

Support Engineer

EXEMPLE

Isabel Martínez

Research Project Manager

Contact

Open Positions available. You can send your CV and cover letter to hiest@bsc.es

Barcelona Supercomputing Center, 2015 - Legal Notice