Albedo to Normal and MER for Blockbench
PBR channels are derived, not painted: albedo → height field → tangent-space normal, then metalness, emissive and roughness inferred from the albedo, the height and the normal's curvature and packed into one MER image. Two scripts share one CLI and the same maths; pick by runtime. Load blockbench-use first for discovery and verification, and blockbench-pbr-materials to assign the results. This skill produces the image files only.
| Runtime | Script | Install | Height estimation |
|---|
| Python | scripts/albedo_to_normal.py
| (+ for depth) | Depth Anything V2 through transformers, CUDA when available |
| Node.js | scripts/albedo_to_normal.mjs
| (+ @huggingface/transformers
| Depth Anything V2 ONNX through transformers.js, CPU or WebGPU |
Both write
(grayscale, light = high),
(RGB, opaque) and
(R metalness, G emissive, B roughness) and print a JSON report. Runtime setup, API notes and troubleshooting:
references/python-pypbr.md,
references/node-vgpu.md. Node needs the script's
folder reachable from a project that has the dependencies installed; Python only needs the packages.
Workflow
1. Get the color texture as a file
Run
and note the target texture's UUID,
and
; it does not report a file path. If the texture was imported from a file you wrote (for example the downscaled atlas from the GPT image workflow), use that file. Otherwise fetch the image with
and save the returned PNG to disk, or have Blockbench save the texture. Work on the atlas at its native texel size, not on an upscaled generation canvas, so the maps share the texel grid with the color map.
Check the atlas before deriving anything: relief scale must be consistent across faces, so apply UV scale and distortion guidance to the color map first. A normal map inherits every stretch in the UV layout.
2. Choose the height source
| Source | Flag | Use for |
|---|
| Luminance (default) | --height-source luminance
| Pixel art and flat-shaded painted textures. Light reads as high; add when dark paint is the raised part (dark grout should stay low). |
| Depth Anything V2 | | Photographic or painterly textures with real structure: bricks, planks, cobble, foliage, machinery. Useless on a two-tone checker. Depth is downloaded on first use. |
| Height file | --height-source file --height-file h.png
| A height painted in Blockbench, from another tool, or a previous to reshape. |
Depth estimation sees a photo, not a tile: it returns a foreground-to-background ramp that breaks tiling. The script keeps
and normalize on for depth; add
(about a quarter of the tile width) for non-linear bias and
for seamless tiles. Small textures are nearest-neighbour upscaled to at least 1024 px before the model and block-averaged back, so 16× art keeps its edges. Details:
references/height-processing.md.
3. Run
bash
# tiling 16x block, pronounced pixel relief
python scripts/albedo_to_normal.py block.png --out ./pbr --wrap --strength 1
node scripts/albedo_to_normal.mjs block.png --out ./pbr --wrap --strength 1
# entity/prop atlas with transparent gutters (islands isolated automatically)
python scripts/albedo_to_normal.py goal_atlas.png --out ./pbr --strength 0.5
# HD tile from a painterly texture, depth-estimated, softened for smooth relief
node scripts/albedo_to_normal.mjs planks.png --out ./pbr --height-source depth --high-pass 32 --seam offset --wrap --soften 1
| Flag | Default | Effect |
|---|
| off | Sample across borders. On for seamless tiles, off for atlases and non-tiling art. |
| 0.5 | Gradient multiplier. 0.25 subtle, 0.5 default, 1–2 strong pixel relief; halve per doubling of texture density. |
| sobel | , (softer), (smooth HD height). |
| directx | green-down (Bedrock RTX assumption) or green-up (Blender, glTF, labPBR). |
| 8 | Albedo alpha below this is off-island: no relief bleeds across gutters; gutters get the flat normal. |
| 0 | Density-scaled Gaussian on the height (≈ shortSide/64 · M texels). Use 1 for ≥64× textures; keep 0 for 16×. |
| 0,1,1 | Input black/white/gamma on the height before the kernel. |
| , , /, | depth: 1, 0, on | Depth shaping, also available for and sources. |
--seam offset --seam-amount A
| off, 0.15 | Wrap-and-heal seam blend on the height for tiles. |
| , | off | Skip writing / . |
| , , | auto | infers the channel; a 0..1 value makes it uniform ( for anything that is not metal). |
--palette "#RRGGBB=m,e,r;..."
| none | Exact-colour MER overrides; keeps the inferred channel. The precise tool for pixel-art palettes. |
| , , , , | 0.25, 0, 0.4/0.3/0.3, 1, 0 | Roughness terms: normal curvature (crevices rougher, ridges smoother), height influence, variance/edge/saturation weights, output remap. |
| , , , , | 0.6, 0.15, 0.11–0.17, 0.03–0.10, clean on | Metal heuristic thresholds; the clean-up is a 3×3 majority vote against speckle. |
| , , , | 0.8, 0.5, 1 (off), 0 | Emissive thresholds, over-bright fallback, glow-edge anti-aliasing. |
| Python , ; Node , , | | Runtime specifics; see the references. |
MER inference is heuristic. Read
references/mer-inference.md before tuning it: bright desaturated colours read as metal and bright saturated colours read as glow, which is wrong for wool, bone, snow, pale skin, yellow beaks and painted signs. Decide the material first, then choose
, a uniform value or palette overrides per channel.
4. Read the report
The JSON on stdout ends with
and
. For the normal, require
and
classification: "standard"
;
near 0 and
0. A
classification means the albedo argument was a grayscale image;
with a large bias on a tile means an unflattened ramp in the height.
is informational (high on flat art and on atlases with big gutters).
For the MER, compare
and
with what the material actually is, and
with how matte it should look. A wooden crate with
0.4 means the pale planks were misread as steel: rerun with
or a palette.
0 with a palette means the colour did not match exactly. The report says the encodings are sound, not that the relief direction, scale or material assignments are right; that is step 6.
5. Import and assign in Blockbench
create_texture: name="<name>_normal", data="<absolute path to <name>_normal.png>"
create_texture: name="<name>_mer", data="<absolute path to <name>_mer.png>"
create_pbr_material: name="<material>", color_texture="<albedo>", normal_texture="<name>_normal", mer_texture="<name>_mer"
# or on an existing material:
assign_texture_channel: material="<material>", texture="<name>_normal", channel="normal"
assign_texture_channel: material="<material>", texture="<name>_mer", channel="mer"
get_material_info: material="<material>"
Bedrock texture sets take
or , never both. Assign the
as
instead when the target is 16× vanilla-style pixel art and the pack convention prefers heightmaps; otherwise use the normal. A MER texture requires the color texture on the same material; when the whole surface shares one metal/emissive/roughness value,
on the material is simpler than a map (generate with
). Match
/
on
to the color texture in formats with per-texture UV sizes. Channel rules, uniform MER values and
are in
blockbench-pbr-materials.
6. Verify direction and scale
Look at the lit model with
from at least two angles and at the intended viewing distance:
- Raised features must read as raised. Inverted top-to-bottom shading means the wrong green convention: regenerate with the other . Everything reading inverted (pits as bumps) means the height sense is wrong: regenerate with .
- Relief must look the same size on every face. Adjust globally; fix uneven results in the UV layout or the color atlas, not by hand-editing the normal.
- Tiling blocks: place several copies and check the seams; and on the height are the fixes, not painting over the seam.
- No rim around atlas islands. If one appears, the albedo alpha was not clean; raise or clean the gutters and regenerate.
- Metal regions must be the parts that are metal (they turn dark and reflective under RTX), glow must sit only on light sources, and roughness must not make cloth or paint shiny. Fix with uniform values, palette overrides or the roughness terms, and regenerate the MER rather than painting it.
- The rendered preview only proves Blockbench's shading; confirm in the target game or renderer before delivery.
What to expect
- Luminance height is an artistic proxy: painted highlights become bumps and painted shadows become pits. It is the right choice for stylised and pixel art, and wrong for photo-sourced textures.
- Depth estimation on textures is relief-plausible, not measured. Expect per-run variation between the PyTorch and ONNX model conversions and treat / / as required cleanup for tiles.
- Both runtimes produce byte-identical heights from the same luminance input, normals within two levels of each other from the same height, and MER within three levels on roughness with identical metal masks.
- MER inference is colour and shape heuristics, not material recognition. Expect false metal on pale desaturated areas and false glow on bright saturated ones; the report makes both visible and the overrides fix them without painting.
- PyPBR's own
compute_normal_from_height
- Node resolves , and the shaders from the script's location; without a GPU, run
npx vgpu install-software-renderer
Resources
- references/height-processing.md: the height and normal pipeline stage by stage, depth shaping, kernel maths, conventions, report fields, runtime parity.
- references/mer-inference.md: how metalness, emissive and roughness are inferred, every MER flag, overrides, the MER report and the checks to run.
- references/python-pypbr.md: install, PyPBR material API and quirks, Depth Anything through transformers.
- references/node-vgpu.md: install, vgpu compute/texture API used by the script, WGSL notes, transformers.js depth in Node.
scripts/albedo_to_normal.py
scripts/albedo_to_normal.mjs
scripts/shaders/height-map.wgsl