Module

Language Models: Machine Learning Basics to Modern Artificial Intelligence

Sprachmodelle: von Grundlagen des maschinellen Lernens zur modernen Künstlichen Intelligenz

6 LPjedes SemesterEN

Voraussetzungen

Empfohlen, im Wortlaut

• basic Python programming • basic linear algebra • basic probability/statistics

Inhalte

• Artificial Intelligence: definitions, scope, history, limitations • Machine Learning vs. Deep Learning: formulations, data, losses, generalization; MNIST case study • NLP (Natural Language Processing) fundamentals: text as data, tokenization, representations • Word embeddings: motivation, distributional semantics, strengths and weaknesses • CNNs and RNNs: explanation, comparison and analysis • Transformers: self-attention intuition, components, impact • Language Models and LLMs: pretraining, scaling, evaluation, failure modes • Practical use of LMs: fine-tuning, prompting, RAG, reasoning behavior and constraints • Overview of multimodal models: VLMs, VLAs etc.

Lernziele

After successful completion of the module students understand core concepts of supervised and unsupervised machine learning with a focus on NLP (Natural Language Processing); can explain and implement representation-learning methods from word embeddings to Transformers; can critically compare assumptions, objectives, trade-offs, and failure modes; can discuss foundation model families (LLMs, VLMs, VLAs); can design basic experiments, evaluate models, and communicate results clearly.

Prüfungsleistung

• written examination, 90 minutes

Literatur (2)
  • Bishop, Pattern Recognition and Machine Learning
  • Manning & Schütze, Foundations of Statistical Natural Language Processing

Bemerkungen

• Study programme Artificial Intelligence M.Sc.: Compulsory elective module in complex „Learning and Reasoning” • Study programme Informatik M.Sc.: Compulsory elective module in complex „Angewandte und Technische Informatik” (Niveaustufe 400) • Study programme Mathematics M.Sc.: Compulsory elective module in complex „Applications” • Study programme Mathematical Data Science M.Sc.: Compulsory elective module in complex „Fundamentals of Data Science” • Study programme Micro- and Nanoelectronics M.Sc.: Compulsory elective module in complex „Applications” • Study programme Medizininformatik B.Sc.: Compulsory elective module in complex „Informatik”

Quelle: Modulbeschreibung der BTU · abgerufen 19.10.2026Original

Modulkatalog · inoffiziell

Betula ist ein inoffizielles Projekt und gehört nicht zur BTU.

Folia 1.0.3Radix 0.6.0

Daten vom 21.10.2026WiSe 2026/27Quelle: BTU