Foundations of Parallel Systems

This course aims to introduce students to the architecture of parallel and distributed systems, from multicore and manycore processors to clusters, large supercomputers and server farms. These systems are studied from the point of view of hardware and configuration, introducing performance improvement techniques and cost analysis, and improving their reliability and availability.

The subject is divided into 4 topics:

1. Introduction to parallel and distributed systems. Basic concepts about performance.
2. Types of architecture of parallel systems. Interconnection networks.
3. Multiprocessor and multicore shared memory systems. Cache coherency and consistency. Manycore systems and GPUs.
4. Message passing systems. Programming with MPI. Clusters.

Basic:
- John L. Hennessy, David A. Patterson. Computer Architecture. A Quantitative Approach, 6th edition, Morgan Kaufmann, 2017.

Complimentary:
- Julio Ortega, Mancia Anguita, Alberto Prieto. Arquitectura de Computadores. Ediciones Paraninfo, 2005.
- Vivek Kale. Parallel Computing Architectures and APIs: IoT Big Data Stream Processing, CRC Press, 2019
- W. Stallings, Computer Organization and Architecture: Designing for Performance, 11th edition, Pearson, 2019.
- Georg Hager, Gerhard Wellein Introduction to High Performance Computing for Scientists and Engineers, 1st edition, 2011 (2ª in 2021).
- William J. Dally, Brian P. Towles. Principles and Practices of Interconnection Networks, Morgan Kaufmann, 2004.
- Hesham El-Rewini, Mostafa Abd-El-Barr. Advanced Computer Architecture and Parallel Processing, Wiley 2005.

Contribute to achieving the skills included in the report of the degree in Computer Engineering at USC (CG4, CG6, CG9, CG11, TR1, TR2, TR3, FB5, RI1, RI9, RI14, TI2, TI5).

Competences associated with the computer engineering module within the degree:

- Knowledge of the architecture of parallel and distributed systems both from the point of view of hardware and implementation and from the point of view of their programming.

In the face-to-face classes use will be made of the blackboard and of multimedia systems and slides. In these classes, the lecturer will present and develop the fundamental aspects of each one of the subjects of the subject. The contents that are approached in these classes are going to be sufficient so that the practices of the subject can be realized; in addition, all the concepts that will be required to pass the subject will be explained.

The practices will make use of the classrooms of computer science of the school and of the systems of supercomputación provided by the CESGA. It will be tried that the students work individually or in small groups.

In addition, use will be made, as far as possible, of the capabilities of USC-Virtual. On the subject page, students will be able to obtain a copy in digital format of the material used in the theoretical and practical classes, as well as supplementary material and links to web pages related to the contents of the subject.

As for the competencies that the student must acquire, in the expository classes the competences CG4, CG6, CG11, FB5, RI1, RI9, RI14, TI2 and TI5 will be worked, and in the interactive classes the competences CG4, CG6, CG9, TR1, TR2 will be worked. , TR3, RI4.

The assessment of learning will be based on the effective performance of a continuous assessment and a final exam. The continuous evaluation will be based on the effective realization by the students of the practices proposed along the term and on the realization of the works and exercises proposed. The final exam will include all the contents of the subject.

Therefore, the evaluation of the subject consists of two sections that are evaluated independently: final exam and continuous evaluation of the practices, works and exercises. The final exam accounts for 50% of the final grade and the continuous assessment part accounts for the other 50%. In any case, to pass the subject it is an essential requirement to have a grade equal to or greater than 4 in each of these two parts, and that the arithmetic mean between both grades is greater than or equal to 5.

Attendance at internships is mandatory. Each of the proposed practices will have a specific end date. After this date, the practice will be considered as not done. At the end of each of the proposed practices, the student must send it to the teacher. Internships will be evaluated during sessions subsequent to the delivery date.

JULY OPPORTUNITY
There will be a final exam on the theory of the subject, as in the ordinary assessment. In addition, and only on this occasion, concerning practice, there will be a final exam for students who do not pass the continuous assessment in the February call.

CONDITION OF "NOT PRESENTED"
Students will receive the grade of "not presented" when they do not take the final theory exam in either of the two calls.

In the case of fraudulent performance of exercises or tests, the provisions of the Evaluation regulations will apply. of student academic performance and grade review .

In application of the ETSE regulations on plagiarism (approved by the ETSE Board on 19/12/2019), the copy total or partial of some exercise of practices or theory will suppose the suspension in the two opportunities of the course, with the qualification of 0,0 in both cases.

The estimated distribution of hours to be devoted to the subject is as follows:

- 10 hours of masterclasses
- 30 hours of practice
- 2 hours dedicated to tutorials and resolution of doubts

The autonomous work of the students is of, approximately, 70,5 hours, that include autonomous study, writing of exercises and works, preparation of the practices, evaluation of works and realization of examinations.

The total number of hours is 112.5 hours.

- It is recommended to have passed (or at least studied) the subjects Computer Architecture and Computer Engineering, and programming knowledge in C language.

- The realization of the practices proposed in parallel with the development of the different subjects results decisive for the assimilation of a way resolved and ordered of the different concepts that study.

- Course materials and electronic communications with students will be carried out with the tools of the USC virtual campus.
- The subject "Programming of Emerging Architectures" is the perfect complement to this subject.
- Lectures will be in Spanish.