A WORKING group will be established to investigate the lack of housing for people with disabilities.

Federal Member for Bendigo Lisa Chesters said the group would involve local, state and federal government agencies as well as local disability services.

Ms Chesters announced her intention to form the group following a meeting on Tuesday with opposition spokeswoman on housing and homelessness Senator Jan McLucas and parents of adults with intellectual disabilities.

"We need to come up with a plan or ideas and concepts locally to solve this problem," Ms Chesters said.

"The other step is to lobby the federal government to make disability housing a key part of the NDIS."

Several of the parents were moved to tears as they told Ms Chesters and Senator McLucas their personal stories of their struggles of caring for decades for their highly dependent children. 

They spoke of the toll providing round the clock care had taken on their marriages, relationships with their other children and grandchildren and their own wellbeing.

Ms Chesters said the stories from the parents hit home.

"A lot of the parents in the room had adult children who were around my own age," she said.

"I just kept think about what would have happened to my mum if she had to continue to be my full time carer."

"The fact is that government policy has failed to give them appropriate housing options and support."

Ms Chesters said the disability housing sector needed a shake-up. 

"Families need to have the option to sit down with an independent advocate and talk through their options," she said.

"They need to be able to have a frank and honest discussion and receive independent advice about the options available."

Senator McLucas told the parents a workable disability housing scheme required flexibility.

"It's got to be very targeted to an individual family but also flexible so it can change over time," she said.