Yes, JioPhone comes with the removable 2000 mAh battery.
JioPhone comes with 4GB Internal Memory. So, you can save as many as you want - depending upon the free memory on the phone.
Yes, JioPhone does support the Kannada language.
No. You cannot use CDMA sim card in the JioPhone.