In creo,Is it possible to control orientation of coordinate system in family table(X,Y,Z AXIS)?

Absolutely!  Create your new coordinate system then create a family table.  When you add the columns to the table make sure Dimension is the choice and pick your new coordinate system.  You should see all 6 values (X,Y, Z translation and rotation dimensions) that you can select and add to/manage in your table.