COMP Superscalar

Big Data Distributed Computing Programming Models

COMP Superscalar (COMPSs) is a framework which aims to ease the development and execution of applications for distributed infrastructures, such as Clusters, Grids and Clouds.

Software Author: 

Workflows and Distributed Computing Group

Contact:

Jorge Ejarque (jorge [dot] ejarque [at] bsc [dot] es)

Rosa M. Badia (rosa [dot] m [dot] badia [at] bsc [dot] es)

Software Cost: 

COMP Superscalar is distributed under Apache License version 2

Primary tabs

COMPSs Download Form
Please, fill the following form in order to access this download:
2 + 10 =
Solve this simple math problem and enter the result. E.g. for 1+3, enter 4.
COMPSs VM Download Form
Please, fill the following form in order to access this download:
1 + 0 =
Solve this simple math problem and enter the result. E.g. for 1+3, enter 4.

2.3 (Latest Version)

COMP Superscalar Version 2.3 (Daisy) Release date: June 2018

Release Notes

New features

  • Runtime:
    • Persistent storage API implementation based on Redis (distributed as default implementation with COMPSs)
    • Support for FPGA constraints and reconfiguration scripts
    • Support for PBS Job Scheduler and the Archer Supercomputer
  • Java:
    • New API call to delete objects in order to reduce application memory usage
  • Python:
    • Support for Python 3
    • Support for Python virtual environments (venv)
    • Support for running PyCOMPSs as a Python module
    • Support for tasks returning multiple elements (returns=#)
    • Automatic import of dummy PyCOMPSs API
  • C:
    • Persistent worker with Memory-to-memory transfers
    • Support for arrays (no serialization required)

Improvements:

  • Distribution with docker images
  • Support for sharing objects in memory between tasks (no file serialization is required now with persistent workers)
  • Source Code and example applications distribution on Github
  • Automatic inference of task return
  • Improved obsolete object cleanup
  • Improved tracing support for applications using persistent memory
  • Improved finalization process to reduce zombie processes
  • Several bug fixes

Known Limitations

  • Tasks that invoke Numpy and MKL may experience issues if a different MKL threads count is used in different tasks. This is due to the fact that MKL reuses  threads in the different calls and it does not change the number of threads from one call to another

For further information please refer to COMPSs User Manual: Application development

Ubuntu x86_64

COMPSs Ubuntu x86_64 repository list. Check Installation manual for details about how to install from the repository

Ubuntu noarch

COMPSs Ubuntu noarch repository list. Check Installation manual for details about how to install from the repository

Debian x86_64

COMPSs Debian x86_64 repository list. Check Installation manual for details about how to install from the repository

Debian noarch

COMPSs Debian noarch repository list. Check Installation manual for details about how to install from the repository

CentOS x86_64

CentOS x86_64 repository. Check Installation manual for details about how to install from the repository

SUSE x86_64

SUSE x86_64 repository. Check Installation manual for details about how to install from the repository

SUSE noarch

SUSE noarch repository. Check Installation manual for details about how to install from the repository

Read this document before downloading the VM image: COMPSs VM Instructions

COMPSs VM
COMPSs Docker Image

Old Versions

2.2

2.1

2.0

1.4