I’m in much the same position. Ironically, I came across your post searching for “omnifocus android”.
Right now I’m doing something similar to what you have described, using OF as the base line and using Toodledo and/or Evernote (still experimenting) as a sort of mobile inbox. But you’re right, it’s annoying and inefficient. What would be lovely would be if OmniFocus (or even Things or The Hit List) could sync with a web service (preferably Toodledo but I’d be okay with RTM also). That, I think, would be the best of all worlds for everyone. Also I would like magical flying ice cream ponies as well.