Think you need perfect credit to buy? A 580 score can still get you in the door with only 3.5% down. Stack that with the idea of house hacking so you can live for cheap!
Most people who start to build wealth in real estate started from the bottom. They knew nothing, had no experience - they just decided one day that they were going to start.