Take what "people" tell you with a grain of salt. "People" talk a lot and are often short on facts.
That said: you aren't supporting your children. Their father isn't supporting them. If your grandmother is getting financial help from the state help raise YOUR children, then you will be...