All startups are new businesses, but not all new businesses are startups.
In common parlance, startups are technology companies trying to develop and market a new product or service. Startups begin without knowing if there is product-market fit, since the product is new to the market. Early on, many startups are unable to define their target market and must iterate over time to find a market in which their product can gain traction.
In contrast, most new businesses are addressing a known market need using an established business model. In it's first year or so, a grocery store, medical practice, restaurant, or bank would each qualify as a new business, but they would not typically be referred to as startups. These businesses are taking known products or services to an well understood market using a familiar business model.
New businesses have lots of market research options, while startups have few.
Because new businesses use well known business models, they know what market they are targeting. They can segment the market by location, income, education, gender, etc., and there are many services that will help them learn more about their target market. Here's an advanced example: There are market research services that can take a list of your customers' credit card numbers and tell you what other neighborhoods contain households with similar spending habits to those of your customers. These are the neighborhoods you can target for your next location.
B2C Startups, on the other hand, have a difficult time segmenting the market in a way that provides enough specificity to make a market research service valuable. B2B Startups have it a bit easier, but most still struggle.