Markov decision process

mathematical model for sequential decision making under uncertainty

Facts

4 properties
🏷️ Also known as
en Markov decision process en MDPs en MDP ar قرارات عملية ماركوف cs Markovův rozhodovací proces de Markow-Entscheidungsproblem es Proceso de decisión de Márkov fa فرایندهای تصمیم‌گیری مارکوف fr MDP fr processus de décision markovien he תהליך החלטה מרקובי it processo decisionale di Markov ja マルコフ決定過程 ko 마르코프 결정 과정 pt Processo de decisão de Markov ru марковский процесс принятия решений sv Markov-beslutsprocess tr Markov karar süreci uk марковський процес вирішування vi Quá trình quyết định Markov
🔖 Identifiers · 6
OpenAlex ID
C106189395
Encyclopedia of China (Third Edition) ID (2026)
4KYZ2E
Encyclopedia of China (Third Edition) old ID (2021)
56113
Freebase ID
/m/048gl8
Microsoft Academic ID (discontinued)
106189395
PSH ID
7713

Report an error or request removal Lineage (PROV-JSON)

Press Enter · cited answer in seconds

📑 Cite this page

Use these citations when quoting this entity in research, articles, AI prompts, or wherever provenance matters. We aggregate Wikidata + Wikipedia + authoritative open-data sources; the stitched, scored, cross-referenced view is what 4ort.xyz contributes.

APA 4ort.xyz Knowledge Graph. (2026). Markov decision process. Retrieved November 14, 2026, from https://4ort.xyz/entity/markov-decision-process
MLA “Markov decision process.” 4ort.xyz Knowledge Graph, 4ort.xyz, 14 Nov. 2026, https://4ort.xyz/entity/markov-decision-process.
BibTeX @misc{4ortxyz_markov-decision-process_2026, author = {{4ort.xyz Knowledge Graph}}, title = {{Markov decision process}}, year = {2026}, url = {https://4ort.xyz/entity/markov-decision-process}, note = {Accessed: 2026-11-14}}
LLM prompt According to 4ort.xyz Knowledge Graph (aggregator of Wikidata, Wikipedia, and authoritative open-data sources): Markov decision process — https://4ort.xyz/entity/markov-decision-process (retrieved 2026-11-14)

Canonical URL: https://4ort.xyz/entity/markov-decision-process · Last refreshed:

Edit History

Rolling log of changes to this entity's Wikidata record. Values shown reflect the current state of each edited property — follow the history link to see the precise diff for any edit.

  1. 18w ago · Nyuhn · 2026-07-10 view diff on Wikidata ↗
    Subclass of → decision making, stochastic process
    Derivative work → partially observable Markov decision process
    Encyclopedia of China (Third Edition) ID (2026) → 4KYZ2E
    Named after → Andrey Markov
    + 1 other property edited (see Wikidata diff for full list)
    "Changed the item: QuickStatements 3.0 batch #40849: ZGBK ID"
Live feed via Wikidata EventStreams. New edits appear within minutes of being made on Wikidata.