Cameron’s attack follows a pledge last week by business secretary Vince Cable to simplify the planning regime to make it easier to win approval for new developments.
Cable has said he is considering introducing a system of "land auctions" to encourage more land to come forward for development.
In his speech, Cameron also directed his ire at "government bureaucrats" and public sector procurement managers.
Cameron said: "We taking on the enemies of enterprise: The government bureaucrats who concoct those ridiculous rules and regulations that make life impossible, particularly for small firms. … Public sector procurement managers who think that the answer to everything is a big contract with a big business and who shut out millions of Britain's small and medium sized companies from a massive potential market."
Cameron confirmed that a New Enterprise Allowance would be put in place to support unemployed people with a "sound business plan" with up to £2,000 of support, first announced at the Conservative Party conference last autum. He also said that he was "throwing open" government procurement to "every single business in our country".
The Budget will be announced by the chancellor on 23 March.