Fundamentals of Memory Management

Back to Operating Systems
Arjit Sharma
02 Mins

Memory management plays a crucial role in modern computing, ensuring efficient allocation, tracking, and utilization of system resources. Without proper management, processes compete for memory, leading to slowdowns, crashes, or inefficient resource use.

Memory Hierarchy

Memory is structured in a hierarchy, balancing speed, size, and cost to optimize performance.

Levels of Memory Hierarchy (Fastest to Slowest)

1️⃣ Registers – Embedded within the CPU, storing immediate values.

2️⃣ Cache Memory – High-speed memory storing frequently accessed data.

3️⃣ Main Memory (RAM) – Primary storage for active processes.

4️⃣ Secondary Storage (HDD/SSD) – Stores long-term data, slower than RAM.

5️⃣ External Storage (USB, Cloud, etc.) – Portable or network-based storage.

Example: CPU Accessing Frequently Used Data

When playing a game, your CPU fetches textures and game logic from RAM, but frequently accessed game settings or computations are stored in cache for faster retrieval.

Locality of Reference

Programs access memory in predictable patterns, known as locality of reference:

🔹 Temporal Locality – Recently used memory is likely to be used again.

🔹 Spatial Locality – Nearby memory locations are accessed together.

Example: Web Browsing

When revisiting a webpage, browsers use cached images and scripts, reducing load times by avoiding unnecessary re-fetching.

Memory Allocation Policies

1. Fixed Allocation

Processes receive predefined memory, regardless of actual usage.

🔹 Used in: Simple systems where memory availability is static.

2. Dynamic Allocation

Memory is assigned based on process demands, improving efficiency.

🔹 Used in: Multitasking systems like modern OSes, adjusting allocation based on active applications.

3. Paged Allocation

Memory is divided into fixed-size pages, ensuring efficient resource use (explored in detail later).

🔹 Used in: Operating systems like Windows and Linux for process isolation.

Conclusion

Efficient memory management ensures smooth execution, balancing speed, allocation, and optimization strategies. Understanding memory hierarchy, locality of reference, and allocation policies is fundamental for debugging, performance tuning, and system design.

Next →