Ceramic composite separators (CCSs) play a critical role in ensuring safety for lithium-ion batteries (LIBs), especially for mid- and large-sized devices. However, production of CCSs using organic solvents has some cost and environmental concerns. An aqueous process for fabricating CCSs is attractive because of its cost-effectiveness and environmental-friendliness because organic solvents are not used. The success of an aqueous coating system for LIBs is dependent upon minimizing moisture content, as moisture has a negatively impact on LIB performance. In this study, CCSs were fabricated using an aqueous coating solution containing Al2O3 and an acrylic binder. Compared with polyethylene (PE) separators, CCSs coated with an aqueous coating solution showed improved thermal stability, electrolyte uptake, puncture strength, ionic conductivity, and rate capability. In addition, our new approach of introducing a small amount of an oily liquid to the aqueous coating solution reduced the water adsorption by 11.7% compared with coatings that do not contain the oily liquid additive.