ADC Home > Reference Library > Technical Q&As > Hardware & Drivers > Open Firmware >

What is a tokenizer?

Q: What is a tokenizer?

A: The tokenizer, defined in Appendix C of IEEE 1275, is a program that converts FCode text into FCode binary. The tokenizer can be used by developers to convert their source to binary prior to loading that binary in the expansion ROM of their device.

[Mar 29 1999]

Did this document help you?
Yes: Tell us what works for you.
It’s good, but: Report typos, inaccuracies, and so forth.
It wasn’t helpful: Tell us what would have helped.