We report on a comprehensive study of the magnetization, resistivity and heat capacity on the single crystals of Ce2RhGa12 synthesized using Ga flux. Single crystal X-ray diffraction data confirm the tetragonal Pb/nbm structure of Ce2RhGa12, which is isostructural to Ce2PdGa12. Ce2RhGa12 orders antiferromagnetically at TN = 3.5 K and exhibits anisotropic magnetic behavior, inferred from the magnetization and resistivity data, taken along the two principal crystallographic directions of the crystal, viz., along [100] and [001]. The anisotropic magnetic response of Ce2RhGa12 establishes [001] as the easy axis of magnetization, and a weak meta-magnetic transition is also observed in the magnetic isotherm at 2K along the same axis. A sharp peak in specific heat signals the bulk antiferromagnetic transition at TN = 3.5 K, which shifts to lower temperatures in low applied fields. The electrical resistivity along the two directions shows metallic behavior from 300K down to 1.8K and establishes Ce2RhGa12 as a normal, trivalent cerium compound.