As the name suggests, Pauper is the go-to budget format. Admittedly, it's less cheap than it used to be. But at its cheapest, it is one of the least expensive.
EDH (Commander) has a huge range in price, but some decks (check out The Commander's Quarters on YT) are super fun and affordable. It's a good casual format to start a budget deck with and continue growing. It's also a gateway drug, so be warned ๐ฌ
Lastly, if you are playing in a private pod (i.e., not at your LGS), you can set your own limits based on market price. For example, no decks over 50 bucks total, no single high-cost card over 10 bucks, etc. Ultimately, rule zero applies to budget-conscious private games. You decide what's allowed.