If you plan to continue, create an engine.
Sniggle was far too harse. RPG creation tools are nothing new, and RPG Maker 2003 isn't the first, so he shouldn't claim this is based on it. However, I must agree that testing whatever you make is necessary. What good is a RPG Maker that doesn't allow you to play the games you create? Also, how would I go about saving the maps, scripts, characters, and whatever else I create? This RPG Maker needs tons of work.
Now on to the praise: I love the tiles engine. You did good with the editor. It works a lot like the RPG Maker 2000 editor, but it has lower quality graphics. Granted, these graphics are vector art, so you could zoom in 10x and retain a lot of detail.
Other than the tiles editor, there wasn't much to this RPG engine. I still think you'll need to actually create the game in Flash to create anything worth playing, so I suggest you start creating an open-source RPG engine rather than a RPG creator. Keep the tiles editor, though. It's a masterpiece.
I don't like how slow the editor kept getting. The browser window froze every few seconds to load an error message asking about saving data to my cache. I shouldn't have to save anything to cache until I finish working on my creation. For that matter, it shouldn't save the game to cache. It should allow you to save wherever you like. I blame Macromedia for this limitation, though.