Is the idea to have the binary files described in RNC or to have an RNC description of the existing grammar XML format? As I understand RELAX NG (Compact) is just another way to describe an XML format - like DTDs and XML schema..
There's already an XML schema describing the Synalyze It! grammars.
May you want to share your use case?