Information Theory and Coding

Major: Cybersecurity
Code of subject: 6.125.00.O.020
Credits: 5.00
Department: Information Technology Security
Lecturer: D.Sc., prof. Ihor M. Zhuravel
Semester: 3 семестр
Mode of study: денна
Learning outcomes: ЗН 4. Analyze, argue, make decisions in solving complex specialized problems and practical problems in professional activities, which are characterized by complexity and incomplete definition of conditions, be responsible for the decisions made. ЗН 6. Critically comprehend the basic theories, principles, methods and concepts in teaching and professional activities. ЗН 13. Knowledge of modern achievements of innovative technologies in the field of information technologies, cybersecurity and management; ZNЗНcybersecurity and information technology;
Required prior and related subjects: prerequisites: • Cryptographic systems and protocols; • Electronics.
Summary of the subject: The amount of information and entropy. Quantization signals. Mathematical models of deterministic signals. Modulated signals. Random signals and their probabilistic characteristics. Simple digital codes. Reflex codes. Noiseimmunity coding (basic principles). Systematic codes. Codes of error detection and correction. Cyclic codes. Optimal reception and processing of information. The effectiveness of information systems. Immunity information systems. Compression methods in information systems.
Assessment methods and criteria: • written reports on laboratory work, oral examination, reference work (30%) • final control (70% control measure, exam), written-oral form (70%).
Recommended books: 1. Електронний навчально-методичний комплекс «Теорія інформації та кодування» для студентів Інституту комп’ютерних технологій, автоматики та метрології напряму підготовки 6.170101 «Безпека інформаційних і комунікаційних систем», укладач – доц. Журавель І.М., реєстр. номер № Е41-118-47/2016 від 16.05.2016 р.). 2. Методичні вказівки до виконання розрахункової роботи з дисципліни “Теорія інформації та кодування” для студентів базового напряму 6.170101 “Безпека інформаційних та комунікаційних систем” / Укл. І.М.Журавель, С.С.Войтусік, Ю.М.Костів, - 34 с. 3. Конспект лекцій з дисципліни “Теорія інформації та кодування” для студентів базового напряму 6.170101 “Безпека інформаційних та комунікаційних систем” (№ 6847 від 26.04.2016 р.), укладач – доц. Журавель І.М. 4. Обозовський С.С. Вимірювальні сигнали та кола. – К.: ІСДО, 1992. 5. Кузьмин И.В., Кедрус В.А. Основы теории информации и кодирования. – К.: Вища школа, 1986. 6. Гоноровский И.С. Радиотехнические цепи и сигналы. – М.: Радио и связь, 1986. 7. Калабеков Б.А., Лапидус В.Ю., Малофеев В.М. Методы автоматизированного расчета спектральных характеристик в технике святи. – М.: Радио и связь, 1990.

Information Theory and Coding

Major: Cybersecurity
Code of subject: 6.125.00.O.021
Credits: 5.00
Department: Information Security
Lecturer: Stakhiv Marta
Semester: 3 семестр
Mode of study: денна
Learning outcomes: As a result of studying the academic discipline, the student must be able to demonstrate the following learning outcomes: 1. knowledge of the principles of creating information systems, the basis of which are the processes of information transmission and transformation; 2. knowledge of the basic provisions of the theory of signal quantization by level and time; 3. understanding the theory of effective coding; 4. knowledge of the basic provisions of the theory of optimal signal reception; 5. the ability to process signals as information carriers, to characterize the main types of deterministic and random signals, methods of their mathematical description and transformation; 6. the ability to apply coding theory when solving practical problems. As a result of studying the academic discipline, the student must be able to demonstrate the following program learning outcomes: KN 4. Analyze, argue, make decisions when solving complex specialized tasks and practical problems in professional activities, which are characterized by complexity and incomplete determination of conditions, be responsible for the decisions made KN 6. Critically interpret the main theories, principles, methods and concepts in education and professional activity KN 13. Knowledge of modern achievements of innovative technologies in the field of information technologies, cyber security and management KN 14. Knowledge and understanding of scientific principles underlying cyber security and information technologies
Required prior and related subjects: • Fundamentals of information and cyber security • Higher mathematics • Operating Systems • Schematics • Programming in script languages
Summary of the subject: The discipline considers the basic concepts and definitions such as: information and information systems, the subject of information theory. The concepts of information quantity and entropy and how they differ are studied. Quantization of signals by time and level and quantization errors are also considered. Mathematical models of deterministic signals and their general characteristics are studied. Different types of modulated signals and their spectra are considered. Random signals and their probabilistic and numerical characteristics are also studied. Simple digital codes and codes with error detection and correction are studied, namely: Heming, cyclic, BCH, iterative, recurrent. The entropy of continuous and complex messages, as well as the amount of information with incomplete reliability of messages and statistical dependence between the elements of messages are considered. The characteristics of the signal and the communication channel are considered. The noise immunity of information systems is studied, as well as ways to increase it, the general characteristics of interference in information transmission systems.
Assessment methods and criteria: Current control is carried out during practical classes in the form of an oral survey, written express control, student presentations during the discussion of theoretical issues and aims to check the level of the student's readiness to perform specific work. Control of practical classes is carried out in order to find out the readiness of students for classes in the form of a selective oral survey before the beginning of classes, checking the completion of homework, calling individual students to the blackboard for independent problem solving, evaluating the student's activity during classes, proposals, original solutions , clarifications and definitions, additions to previous answers. The semester exam is the final stage of the study of the entire discipline and has the purpose of checking the students' knowledge of theory and identifying the skills of applying the acquired knowledge in solving practical tasks, as well as the skills of independent work with educational and scientific literature. The exam gives each student an opportunity in a relatively short period of time to think through the entire course as a whole, to focus on its key points, and to memorize its main content. The exam is written by students during the examination session provided by the curriculum. Full-time education: Current control (40 points): oral survey - 10; performance of laboratory work - 30 Examination control (60 points): written component – 50; oral component – 10 The procedure and criteria for assigning points and grades: Lab: Scoring criteria - completed laboratory work; Maximum number of points: 6 laboratory works *5 points = 30 points Written component: Scoring criteria - correct answers to the questions; Maximum number of points: 50 Oral component: Scoring criteria - correct answers to the questions; Maximum number of points: 10
Recommended books: Навчально-методичне забезпечення 1. Електронний навчально-методичний комплекс «Теорія інформації та кодування» (Адреса доступу: https://vns.lpnu.ua/course/view.php?id=12913) 2. Курс лекцій з навчальної дисципліни «Теорія інформації та кодування» для студентів освітньо-кваліфікаційного рівня «Бакалавр» напрямів підготовки 6.170102 «Системи технічного захисту інформації», 6.170103 «Управління інформаційною безпекою» / Укл.: М.Ю. Стахів - Львів: НУ“ЛП”, 2014. - 51 с. 8. Рекомендована література Базова 1. Кожевніков В.Л. Теорія інформації та кодування Навч. посібник: Д. Національний гірничий університет, 2011, 108 с. 2. Тулякова Н.О. Теорія інформації: [Навчальний посібник] [Електронний ресурс] / Н.О. Тулякова. – Суми: СумДУ, 2008. – 212 с. – Режим доступу: http://elkniga.info/ book_156.html 3. Сорока Л.С. Основи теорії інформації: [Навчальний посібник] Л.С. Сорока. – Харків: ХНУ ім. В.Н.Каразіна, 2007. – 264 с. 4. Жураковський Ю.П. Теорія інформації та кодування в задачах: Навчальний посібник. Житомир: ЖІТІ, 2002, 230 с. Допоміжна 1. https://www.cl.cam.ac.uk/teaching/0809/InfoTheory/InfoTheoryLectures.pdf 2. Shannon, C and Weaver, W (1949) Mathematical Theory of Communication. Urbana: University of Illinois Press. 3. http://www.inference.org.uk/itprnn_lectures/ 4. JV Stone. Information Theory: A Tutorial Introduction. Sebtel Press, Sheffield, England, 2015 5. J Gleick. The Information. Vintage, 2012. 6. DJC MacKay. Information theory, inference, and learning algorithms. Cambridge University Press, 2003. 7. J Soni and R Goodman. A mind at play: How Claude Shannon invented the information age. Simon and Schuster, 2017. 9. Інформаційні ресурси 1. Робоча програма з дисципліни “Теорія інформації та кодування” для спеціальності 6.125.00.00 “Кібербезпека” / Укл.: Стахів М.Ю. – Львів: НУ «ЛП». – 2021. – 8 с. // Віртуальне навчальне середовище “Львівської політехніки”: https://vns.lpnu.ua/mod/resource/view.php?id=573627