Parallel Computing and Tools for their Implementation

Major: Information and Communication Technologies
Code of subject: 7.122.06.E.015
Credits: 6.00
Department: Applied Mathematics
Lecturer: doctor of sciences, senior research fellow Yadzhak M.S.
Semester: 2 семестр
Mode of study: денна
Мета вивчення дисципліни: To study the main methods of organizing parallel calculations and to get acquainted with modern software and hardware means of implementing parallel algorithms.
Завдання: The study of an educational discipline involves the formation of competencies in students of education: general competences: GC2, GC3, GC4, GC5, GC8, GC9, GC12, GC13; professional competences: PC1, PC2, PC3, PC4, PC6, PC7, PC10.
Learning outcomes: - know the main methods of parallel computations organization, main types of modern and perspective parallel computing systems, parallel computing software, parallel algorithms for solving some problems; - be able to investigate the complexity and speed up of parallel algorithms
Required prior and related subjects: - algebra and geometry; - discrete mathematics; - object-oriented programming; - quantum computers; - network software; - queueing theory
Summary of the subject: Parallel computing systems, their classification. Performance of parallel systems. Evaluation of the efficiency of parallel algorithm. Methods of static parallelization of sequential algorithms. The synthezis methods of parallel algorithms.
Опис: Names of lecture topics. 1. Introduction to parallel computing. 2. Parallel computing systems and their classification. 3. Productivity of parallel computing systems and evaluation of parallel algorithms. 4. Components of the communication environment of parallel computing systems. 5. Static and dynamic parallelization of sequential programs and algorithms. 6. Methods of synthesis of parallel algorithms. Parallel algorithms for calculating recursions. 7. Some basic parallel calculation algorithms (for some linear algebra problems, Cauchy problems for systems of ordinary differential equations, digital filtering problems). 8. Parallel computing systems of unconventional architecture. Names of topics of practical classes. 1. Parallelization of acyclic sections of the program or algorithm. 2. Pipelining and vectorization of calculations. 3. Parallelization of cyclic sections of algorithms or programs (methods of parallelepipeds, hyperplanes, pyramids and modification). 4. One-dimensional problem of digital filtering and parallel algorithms for its solution. Topics for independent work. 1. Methods of detecting parallelism, assessment of parallelism, traditional and non-traditional software means of implementing parallelism. 2. Neural network structures. 3. VLIW-systems. 4. Computer systems based on homogeneous computing environments. 5. Means of specifying parallelism in high-level programming languages (Fortran, C, C++, C#, Java, Python, Go).
Assessment methods and criteria: - current control: practical lessons (25%), individual research tasks (15%), writing control test (30%); oral surveys (30%)
Критерії оцінювання результатів навчання: As a result of completing the practical task, the student receives the maximum score in the event that the task is completed correctly and explanations of the progress of its implementation are provided; as a result of the oral survey, the student receives the maximum score if he gives a correct and complete answer to the question (if necessary, clarifying questions are possible to determine the level of students' knowledge).
Порядок та критерії виставляння балів та оцінок: 100–88 points – ("excellent") is awarded for a high level of knowledge (some inaccuracies are allowed) of the educational material of the component contained in the primary and additional recommended literary sources, the ability to analyze the phenomena being studied in their interrelationship and development, clearly, succinctly, logically, consistently answer the questions, the ability to apply theoretical provisions when solving practical problems; 87–71 points – ("good") is awarded for a generally correct understanding of the educational material of the component, including calculations, reasoned answers to the questions posed, which, however, contain certain (insignificant) shortcomings, for the ability to apply theoretical provisions when solving practical tasks; 70 – 50 points – ("satisfactory") awarded for weak knowledge of the component's educational material, inaccurate or poorly reasoned answers, with a violation of the sequence of presentation, for soft application of theoretical provisions when solving practical problems; 49-26 points - ("not certified" with the possibility of retaking the semester control) is awarded for ignorance of a significant part of the educational material of the component, significant errors in answering questions, inability to apply theoretical provisions when solving practical problems; 25-00 points - ("unsatisfactory" with mandatory re-study) is awarded for ignorance of a significant part of the educational material of the component, significant errors in answering questions, inability to navigate when solving practical problems, ignorance of the main fundamental provisions.
Recommended books: 1. Вальковский В.А. Распараллеливание алгоритмов и программ. Структурный подход. – М.: Радио и связь, 1989. – 176 с. 2. Воеводин В.В., Воеводин Вл.В. Параллельные вычисления. – СПб: БХВ-Петербург, 2002. – 608 с. 3. Каляев И.А., Левин И.И., Семерников Е.А., Шмойлов В.И. Реконфигурируемые мультиконвейерные вычислительные структуры. – Ростов н/Д: Изд-во ЮНЦ РАН, 2008. – 320 с. 4. Ортега Дж. Введение в параллельные и векторные методы решения линейных систем. – М.: Мир, 1991. – 367 с.
Уніфікований додаток: Lviv Polytechnic National University ensures the realization of the right of persons with disabilities to obtain higher education. Inclusive educational services are provided by the Service of accessibility to learning opportunities "Without restrictions", the purpose of which is to provide permanent individual support for the educational process of students with disabilities and chronic diseases. An important tool for the implementation of the inclusive educational policy at the University is the Program for improving the qualifications of scientific and pedagogical workers and educational and support staff in the field of social inclusion and inclusive education. Contact at: St. Karpinsky, 2/4, 1st floor, room 112 E-mail: Websites:
Академічна доброчесність: The policy regarding the academic integrity of the participants of the educational process is formed on the basis of compliance with the principles of academic integrity, taking into account the norms "Regulations on academic integrity at the Lviv Polytechnic National University" (approved by the academic council of the university on June 20, 2017, protocol No. 35).