How do you self - study advanced Markov chains?

So.. I’m not from any junior college or university, so I haven’t learned this chapter yet.

However, I’ve been reading notes on Markov chains (stochastic processes) and I have watched 3 YouTube videos about it.

After watching those videos and reading notes from San Jose state university, I could understand the basic concept of Markov chains, but I still want to learn advanced Markov chains.

No matter how many notes I read, I still can’t seem to understand them.

So, does anyone have tips on how to self-study advanced Markov chains?

Thanks in advance! 🙏

Singapore
2025/8/21 Edited to

... Read moreDiving deeper into advanced Markov chains can be challenging without formal coursework, but a structured approach helps. First, make sure you have a solid grasp of the basics by revisiting foundational topics such as transition matrices, state spaces, and Markov property. The notes from San José State University by Dr. Guangliang Chen provided me with clear mathematical explanations that were very helpful. Next, supplement your reading with high-quality video tutorials. I found the ‘Markov Chains Clearly Explained’ series valuable for visually connecting theory with examples, especially when they cover computation of steady-state distributions and classification of states. Try to solve practice problems from stochastic process syllabi commonly used in B.Tech courses, focusing on exercises involving self-similar Markov processes and continuous-time chains. Websites offering open courseware on these topics can be a good resource. Joining online forums or social communities interested in stochastic processes is another great tip. Discussing problems with peers or experts helped me understand different perspectives and practical applications. Lastly, revisit the mathematical rigor behind Markov chain theorems as covered by authors like Norris. Reading research papers or advanced textbooks once you’re comfortable with intermediate materials can deepen your insight. Remember to pace your learning and regularly summarize what you’ve understood in your own words or notes. This active engagement boosted my retention and helped me tackle complex concepts more confidently.

Related posts

Basic markov chains taught in VJC Year 2 H2 Math?!
I've asked my bf ( Now, my ex) if he had learned about Markov chains before, because I wanted to use them for one of my school projects last year since they involve prediction. He told me he learned basic Markov chains in JC2 H2 Math, but only at a very shallow level. I was suspicious b
𝓡𝓸𝔀𝓵𝓮𝓽 ☀️🧚

𝓡𝓸𝔀𝓵𝓮𝓽 ☀️🧚

16 likes

Looking for friends / bf !!😊
Hii everyone!! I'm a carat and a TNT fan!!💎✨ I love Geography!!🌍 I love listening to kpop music and watching Chinese dramas. Would love to learn about Markov chains!! ⛓️ Places I would like to travel to : San Jose, California, Las Vegas. My Instagram username is @liyingtc 😊
𝓡𝓸𝔀𝓵𝓮𝓽 ☀️🧚

𝓡𝓸𝔀𝓵𝓮𝓽 ☀️🧚

26 likes

Where to learn Advanced Markov chains??
I have been looking at these Advanced Markov chains notes from San Jose state university and I don't understand a single thing.. Felt eager to learn.. Does anyone know if there are YouTube videos that helped to explain it? Thanks! 🙏
𝓡𝓸𝔀𝓵𝓮𝓽 ☀️🧚

𝓡𝓸𝔀𝓵𝓮𝓽 ☀️🧚

2 likes

#嘿嘿
Lemon8er

Lemon8er

0 likes

五行水晶手链,私人订制✅
✨【冷淡风水晶手链|高级混搭风也太绝了!】 最近被这串手链戳中!搭配简约又有细节,日常戴出门总被问link~ 【水晶解析】 ❶ 黑曜石/金曜石/银曜石:招财屏蔽负能量,黑色系自带酷感,质感满分~ ❷ 拉长石:蓝光闪烁像星空,月光效应绝美,温柔氛围感up! ❸ 发晶(钛晶/金发晶):灰色调神秘感,招桃花旺事业,自带光芒感~ ❹ 白水晶:透明感清澈,梯形/圆柱切割超显设计感,放大能量场~ ❺ 灰月光石:柔和灰调,温润气质加成,舒缓情绪稳情绪~ 【设计亮点】 ✓ 不规则形状混搭:梯形、圆柱、圆珠错落排列,打破单调,高级感拉满! ✓ 透明弹性绳:贴合手腕,日常佩戴舒适,久戴不勒~
炑庆师兄

炑庆师兄

1 like

【Chip Giants Team Up! NVIDIA Locks in Intel for 2028 New Platform – Is the Era of US Semiconductor "Dual Supply Chains" Upon Us?】 US chip giants are collectively revamping their supply chain strategies! Breaking news reveals that NVIDIA's upcoming Feynman architecture platform, set
Lemon8er

Lemon8er

0 likes

BITCOIN HIDDEN MARKOV MODEL
Most people look at Bitcoin and see candles. I’m more interested in hidden market states. A 5-minute Hidden Markov Model (HMM) can classify BTC into probabilistic regimes — trend, chop, expansion, compression, momentum shifts, etc. The interesting part isn’t prediction in a “price magicall
JAY TEO

JAY TEO

0 likes