1	Course Title:	INFORMATION THEORY
2	Course Code:	EEM5404
3	Type of Course:	Optional
4	Level of Course:	Second Cycle
5	Year of Study:	1
6	Semester:	2
7	ECTS Credits Allocated:	6
8	Theoretical (hour/week):	3
9	Practice (hour/week) :	0
10	Laboratory (hour/week) :	0
11	Prerequisites:	None
12	Recommended optional programme components:	None
13	Language:	Turkish
14	Mode of Delivery:	Face to face
15	Course Coordinator:	Prof. Dr. TUNCAY ERTAŞ
16	Course Lecturers:	Yok
17	Contactinformation of the Course Coordinator:	Prof. Dr. Tuncay ERTAŞ tertas@uludag.edu.tr Tel: (224) 294 2013 Adres: Elektrik-Elektronik Mühendisliği Bölümü, 5. Kat, Ofis No:523
18	Website:
19	Objective of the Course:	To understand the fundamentals concepts and limits of information and network information theory.
20	Contribution of the Course to Professional Development	Helps students gain ability of theoretical design and analysis of information systems.

21

Learning Outcomes:

1 To calculate the entropy and the mutual information; 2 To calculate the Gaussian channel capacity in the case of white and coloured noise; 3 To calculate achievable rates for various network channels;

22	Course Content:

Week	Theoretical	Practical
1	Introduction to information and network information theory
2	Uncertainity, information, entropy, source coding theorem
3	Data compression: Prefix, Huffman, Lempel-Ziv codes, Kraft inequality
4	Asymptotic equipartition property, law of large numbers, typical sequences
5	Discrete memoryless channels, mutual information, channel capacity
6	Channel coding theorem, differential entropy, capacity theorem, capacity of binary input AWGN channel
7	Gaussian channel capacity
8	Gaussian channel capacity
9	Wireless Channel Capacity
10	Rate distortion
11	Multi-user Gaussian channels, joint typicality
12	MA channels, Slepian-Wolf coding
13	Broadcast channels, relay channels
14	Review

23	Textbooks, References and/or Other Materials:	T. Cover, J. Thomas: Elements of Inf. Theory, Wiley & Sons, 1991.
24	Assesment

TERM LEARNING ACTIVITIES	NUMBER	PERCENT
Midterm Exam	1	25
Quiz	0	0
Homeworks, Performances	2	25
Final Exam	1	50
Total	4	100
Contribution of Term (Year) Learning Activities to Success Grade		50
Contribution of Final Exam to Success Grade		50
Total		100
Measurement and Evaluation Techniques Used in the Course	Measurement and evaluation are performed according to the Rules & Regulations of Bursa Uludağ University on Postgraduate Education.
Information	1 midterm and 1 final exam is conducted in combination with 2 homeworks, and graded by using University's relative evaluation system.

25

ECTS / WORK LOAD TABLE

Activites	NUMBER	TIME [Hour]	Total WorkLoad [Hour]
Theoretical	14	3	42
Practicals/Labs	0	0	0
Self Study and Preparation	14	4	56
Homeworks, Performances	2	0	0
Projects	0	0	0
Field Studies	0	0	0
Midtermexams	1	30	30
Others	0	0	0
Final Exams	1	52	52
Total WorkLoad			180
Total workload/ 30 hr			6
ECTS Credit of the Course			6

26	CONTRIBUTION OF LEARNING OUTCOMES TO PROGRAMME QUALIFICATIONS
PQ1 PQ2 PQ3 PQ4 PQ5 PQ6 LO1 5 0 5 0 0 0 LO2 5 0 5 0 0 0 LO3 5 0 0 0 0 0

LO: Learning Objectives

PQ: Program Qualifications

Contribution Level:

1 Very Low

2 Low

3 Medium

4 High

5 Very High