Language Models: Machine Learning Basics to Modern Artificial Intelligence
Sprachmodelle: von Grundlagen des maschinellen Lernens zur modernen Künstlichen Intelligenz
6 LPjedes SemesterEN
Voraussetzungen
Empfohlen, im Wortlaut
• basic Python programming • basic linear algebra • basic probability/statistics
Inhalte
• Artificial Intelligence: definitions, scope, history, limitations • Machine Learning vs. Deep Learning: formulations, data, losses, generalization; MNIST case study • NLP (Natural Language Processing) fundamentals: text as data, tokenization, representations • Word embeddings: motivation, distributional semantics, strengths and weaknesses • CNNs and RNNs: explanation, comparison and analysis • Transformers: self-attention intuition, components, impact • Language Models and LLMs: pretraining, scaling, evaluation, failure modes • Practical use of LMs: fine-tuning, prompting, RAG, reasoning behavior and constraints • Overview of multimodal models: VLMs, VLAs etc.
Lernziele
After successful completion of the module students understand core concepts of supervised and unsupervised machine learning with a focus on NLP (Natural Language Processing); can explain and implement representation-learning methods from word embeddings to Transformers; can critically compare assumptions, objectives, trade-offs, and failure modes; can discuss foundation model families (LLMs, VLMs, VLAs); can design basic experiments, evaluate models, and communicate results clearly.
Prüfungsleistung
• written examination, 90 minutes
Literatur (2)
- Bishop, Pattern Recognition and Machine Learning
- Manning & Schütze, Foundations of Statistical Natural Language Processing
Bemerkungen
• Study programme Artificial Intelligence M.Sc.: Compulsory elective module in complex „Learning and Reasoning” • Study programme Informatik M.Sc.: Compulsory elective module in complex „Angewandte und Technische Informatik” (Niveaustufe 400) • Study programme Mathematics M.Sc.: Compulsory elective module in complex „Applications” • Study programme Mathematical Data Science M.Sc.: Compulsory elective module in complex „Fundamentals of Data Science” • Study programme Micro- and Nanoelectronics M.Sc.: Compulsory elective module in complex „Applications” • Study programme Medizininformatik B.Sc.: Compulsory elective module in complex „Informatik”
Quelle: Modulbeschreibung der BTU · abgerufen 19.10.2026Original