added physical memory manager
This commit is contained in:
+8
-3
@@ -16,7 +16,10 @@ rather than restate it. Roughly in the order things happen at runtime:
|
||||
4. **[memory-map.md](memory-map.md) — the memory map.** How the loader learns what
|
||||
physical RAM exists and hands it to the kernel in danos's own neutral format,
|
||||
rather than leaking UEFI's memory descriptors across the boundary.
|
||||
5. **[halting.md](halting.md) — halting.** Why a kernel can't just "exit", and
|
||||
5. **[frame-allocator.md](frame-allocator.md) — the physical frame allocator.** The
|
||||
bitmap allocator that hands out and reclaims 4 KiB physical frames from that
|
||||
map — the primitive page tables and the heap will be built on.
|
||||
6. **[halting.md](halting.md) — halting.** Why a kernel can't just "exit", and
|
||||
how `while (true) hlt` parks the CPU safely once there's nothing left to do.
|
||||
|
||||
Cutting across all of these:
|
||||
@@ -30,7 +33,8 @@ Cutting across all of these:
|
||||
The boot flow ties them together: UEFI runs the loader ([efi.md](efi.md)), which
|
||||
queries the **GOP** to pick a graphics mode ([gop.md](gop.md)), hands the kernel a
|
||||
**framebuffer** to draw into ([framebuffer.md](framebuffer.md)) and a **memory
|
||||
map** of physical RAM ([memory-map.md](memory-map.md)); the kernel runs — its
|
||||
map** of physical RAM ([memory-map.md](memory-map.md)); the kernel turns that map
|
||||
into a **frame allocator** ([frame-allocator.md](frame-allocator.md)), runs — its
|
||||
CPU-specific bits behind the [arch](arch.md) boundary — and when it has finished,
|
||||
or panics, it **halts** ([halting.md](halting.md)).
|
||||
|
||||
@@ -39,8 +43,9 @@ or panics, it **halts** ([halting.md](halting.md)).
|
||||
| Area | Code |
|
||||
|------|------|
|
||||
| Bootloader (UEFI app) | `src/efi.zig` → `BOOTX64.efi` |
|
||||
| Kernel entry, panic, memory-map read-out | `src/main.zig` |
|
||||
| Kernel entry, panic, bring-up | `src/main.zig` |
|
||||
| Shared loader↔kernel contract (`BootInfo`, `Framebuffer`, `MemoryMap`, ABI) | `src/root.zig` |
|
||||
| Physical frame allocator | `src/pmm.zig` |
|
||||
| Framebuffer text console | `src/console.zig` |
|
||||
| Arch-specific kernel code (`halt`, linker script) | `src/arch/x86_64/` |
|
||||
| Build + `run-efi` (QEMU/OVMF) | `build.zig` |
|
||||
|
||||
@@ -0,0 +1,111 @@
|
||||
# The physical frame allocator
|
||||
|
||||
Once the kernel knows what RAM exists ([memory-map.md](memory-map.md)), it needs a
|
||||
way to *hand out* that RAM: give me a free page of physical memory, and later,
|
||||
here's one back. That's the **physical frame allocator** (a "physical memory
|
||||
manager", hence `src/pmm.zig`). It deals only in fixed 4 KiB **frames** — the
|
||||
natural unit because that's the granularity the CPU's paging hardware maps — and
|
||||
it is the primitive everything above it stands on: page tables, the kernel heap,
|
||||
per-process memory all ultimately ask the frame allocator for pages.
|
||||
|
||||
It's **generic kernel code**: it operates on the neutral `danos.MemoryRegion`
|
||||
array, so there's no UEFI in it and nothing architecture-specific beyond the 4 KiB
|
||||
page. (Contrast [arch.md](arch.md), which is where CPU-specific code lives.)
|
||||
|
||||
## Why a bitmap
|
||||
|
||||
There are a few classic designs; danos starts with the simplest that still
|
||||
supports freeing:
|
||||
|
||||
- **Bitmap** (chosen): one bit per frame, `1 = used`, `0 = free`. Freeing is
|
||||
trivial (clear a bit), it's very compact, and you can later extend it to
|
||||
allocate *contiguous* runs by scanning for consecutive zero bits. Allocation is
|
||||
a linear scan, but that's cheap and easy to reason about.
|
||||
- **Intrusive free-list / stack**: store the "next free frame" pointer inside each
|
||||
free frame; O(1) alloc and free. Elegant, but it can't satisfy contiguous
|
||||
multi-frame requests and can't answer "is *this* frame free?".
|
||||
- **Buddy allocator**: great for contiguous power-of-two blocks, but more
|
||||
machinery than a first allocator needs.
|
||||
|
||||
Compactness matters less than clarity here, but it's a nice property: 128 MiB of
|
||||
RAM is 32768 frames — a **4 KiB bitmap, a single frame**. Even 64 GiB needs only
|
||||
2 MiB of bitmap.
|
||||
|
||||
## How it works
|
||||
|
||||
State lives in `src/pmm.zig`: the `bitmap` slice, `total_frames`, `used_frames`,
|
||||
and a `next_hint` marking where the next allocation scan should start.
|
||||
|
||||
### init(map) — building it from the memory map
|
||||
|
||||
1. **Size it.** Find the highest address across all `usable` regions;
|
||||
`total_frames = highest / page_size`. Reserved and MMIO spans above that
|
||||
(remember the ~12 GiB of MMIO from [memory-map.md](memory-map.md)) sit *outside*
|
||||
the bitmap and are simply never allocatable.
|
||||
2. **Place it (the bootstrap).** The bitmap needs storage before an allocator
|
||||
exists — a chicken-and-egg. Solution: pick the first `usable` region big enough
|
||||
to hold the bitmap and put it there, addressing it directly as a pointer. That
|
||||
last part relies on the firmware's **identity mapping** still being in effect
|
||||
(physical address == virtual address), which holds until the kernel installs
|
||||
its own page tables.
|
||||
3. **Mark, then free.** Set the whole bitmap to `used` (`0xff`), then walk the
|
||||
`usable` regions clearing their bits. Doing it in that direction means every
|
||||
gap, reserved span, and hole is unallocatable *by default* — we only ever hand
|
||||
back memory the firmware explicitly called usable.
|
||||
4. **Take back the essentials.** Re-reserve the frames the bitmap itself occupies
|
||||
(they're inside a usable region we just freed), plus **frame 0**, so an address
|
||||
of `0` can keep meaning "no frame".
|
||||
|
||||
### alloc() → ?u64
|
||||
|
||||
Scan the bitmap from `next_hint` (wrapping once) for the first free bit, mark it
|
||||
used, advance the hint, and return `frame * page_size`. Returns `null` when no
|
||||
frame is free — genuine out-of-memory. The hint avoids rescanning the low,
|
||||
long-since-allocated frames on every call.
|
||||
|
||||
### free(addr)
|
||||
|
||||
Clear the frame's bit and, if it's below `next_hint`, pull the hint back so the
|
||||
reclaimed frame gets reused soon. Bogus or double frees (a frame already marked
|
||||
free, or one out of range) are ignored rather than corrupting the used count.
|
||||
|
||||
## Correctness points worth remembering
|
||||
|
||||
- **Generic walk.** Because `MemoryRegion` is danos's own type, the map is a plain
|
||||
slice — none of the variable descriptor-stride from the raw UEFI map.
|
||||
- **Identity mapping assumption.** Placing the bitmap by physical address only
|
||||
works while the firmware's identity map is live. When danos sets up its own
|
||||
paging, the bitmap (and any other physical pointer) will need an explicit
|
||||
mapping. This is a deliberate, documented dependency of this stage.
|
||||
- **Frame 0 is reserved** so `0` stays a safe "none" sentinel — and the bitmap is
|
||||
never placed there. (An early bug did exactly that: a `usable` region at physical
|
||||
address 0 collided with a `0`-means-not-found sentinel and tripped a panic. The
|
||||
fix was an optional plus starting the bitmap at least one page in.)
|
||||
- **Everything non-usable is unallocatable by construction** — the "mark all used,
|
||||
then free usable" order gives that for free, so the kernel image, the loader's
|
||||
buffers, MMIO and firmware memory can never be handed out.
|
||||
|
||||
## Verifying it
|
||||
|
||||
`kmain` brings the allocator up and self-tests it. Booted in QEMU with 128 MiB:
|
||||
|
||||
```
|
||||
danos: frame allocator online
|
||||
free frames: 19751 (77 MiB) <- matches the map's 77 MiB usable
|
||||
alloc x3 : 0x2000 0x3000 0x4000 <- frame 0 reserved, bitmap at 0x1000, so allocs start at 0x2000
|
||||
after free : 19751 frames free <- three freed, count restored
|
||||
```
|
||||
|
||||
The `free frames` MiB agreeing with the memory map's `usable RAM`, the three
|
||||
distinct consecutive addresses, and the count returning to its start after freeing
|
||||
are the three signals that init, alloc and free are all correct.
|
||||
|
||||
## What's next (not done here)
|
||||
|
||||
- **Contiguous allocation** — scan for N consecutive free bits — for callers that
|
||||
need physically adjacent frames.
|
||||
- **Consumers**: the virtual memory manager / page tables and then the kernel heap
|
||||
will be the first real users, each asking `alloc()` for frames.
|
||||
- **Reclaiming `reclaimable`** (UEFI boot-services) memory, and eventually the
|
||||
`reserved` `loader_data` (kernel image, boot buffers) once nothing needs it —
|
||||
see the deferred list in [memory-map.md](memory-map.md).
|
||||
+4
-4
@@ -131,12 +131,12 @@ kernel with a **device-tree blob**; the AArch64 entry code will parse its
|
||||
array. The kernel's memory code — the frame allocator and everything above it —
|
||||
never knows the difference.
|
||||
|
||||
## What's next (not done here)
|
||||
## What's next
|
||||
|
||||
This is plumbing plus classification only. Still to come:
|
||||
This page is plumbing plus classification only. The map's first consumer, the
|
||||
**physical frame allocator**, is built directly on the `usable` regions here —
|
||||
see [frame-allocator.md](frame-allocator.md). Still to come after that:
|
||||
|
||||
- A **physical frame allocator** that consumes `usable` regions and hands out
|
||||
4 KiB frames — the foundation everything else stands on.
|
||||
- Reclaiming `reclaimable` regions, and carefully freeing `reserved` `loader_data`
|
||||
(kernel image, these buffers) once the kernel is done reading them.
|
||||
- Paging / the kernel's own page tables, then a heap.
|
||||
|
||||
Reference in New Issue
Block a user