The families involved in the Victoria pub crash were visiting for the weekend.

Two Victorian families visiting Daylesford for the long weekend are among those who were tragically killed and injured after a car crashed into a pub on Sunday night.

Two men in their 30s, a woman in her 40s and a young boy were killed on the scene, and a girl, who was flown to The Alfred hospital, later died at 9.40pm.

Five others are currently in hospital, including a six-year-old boy who is in a stable condition after suffering broken legs and internal injuries, and an 11-month-old boy who is also stable. 

Three adults are also currently receiving treatment, with a 35-year-old woman in ICU.

Emergency service crews rushed to the Royal Hotel on Vincent Street, Daylesford, northwest of Melbourne, at about 6pm on Sunday following reports a car had crashed into a beer garden.

Victoria Police said the deaths occurred after a white BMW SUV mounted the kerb and struck patrons.

The pub was busy before the crash, with patrons out due to the unofficial long weekend in Victoria ahead of Tuesday's Melbourne Cup public holiday.

Emergency authorities said a number of others were injured, including the driver of the car, a 66-year-old Mount Macedon man.

Photos from the scene show investigators assessing a badly damaged white BMW X5.

"I haven't seen anything this drastic for a long time," Superintendent Fitzpatrick told media.

"Any time you have five people die at a particular scene, it's horrible.

"There are families that have got loved ones that are no longer going to be around.

"We don't like to see anyone lose their life but to see a child – you don’t ever want to see anything like that."

Image: Channel Nine.

Chief Commissioner Shane Patton paid tribute to the emergency responders during a press conference on Monday, saying the scene was distressing and confronting. 

“You can’t train someone for that,” he said. “It’s one of the most confronting scenes, I am being told, that experienced officers have been to. It may haunt them forever.”

Commissioner Paton also revealed that the driver, who remains in hospital with minor injuries, returned a negative alcohol reading at the scene, and had no prior convictions.

Crash investigators will be speaking with him later this afternoon.

Infrastructure Minister Catherine King, whose federal Ballarat electorate includes Daylesford, asked the community to follow advice from emergency services as crews carry out their investigation.

"My thoughts are with all those at the scene, their friends and families and the broader Daylesford community," she said in a statement on X.

Anyone who witnessed the incident or has dashcam or CCTV footage is urged to contact Crime Stoppers.

-With AAP.

Feature image: Channel Nine.