Inventory is LOW, so low, across the board, for both rentals and sales. Some of this is simply time of year: fewer people list apartments over the holidays, and there are fewer people leaving their homes than there are "new year new me" people moving to NYC.
We also have a more general lack of available units, as sellers try to figure out when they can get the maximum price (and buy something else with that money), and buyers try to sneak in before the expected mortgage rate increases. And as I've said before, rentals got pushed off of their normal summer lease cycle when units sat vacant until the end of 2020. Add to this a recent COVID wave that has quarantined agents (and owners) sidelined, it's unsurprising we're feeling a crunch.
Because inventory is low, buyers' agents are increasingly advertising themselves as "able to do off-market deals," but literally all of us can do that. Being at a company like Compass (or in an organization like NYRAC) may give some of us an edge, because we can see what our colleagues plan to bring to market, and but I'm not going to pretend I'm the only one who has this access.
And the most important thing to remember about off market deals: they aren't "deals." You are paying a premium to basically skip the line and buy without the unit coming onto market. Is it possible you'll get a good price from a seller you find who doesn't want to go through the effort of cleaning/listing? Perhaps. But they're going to need to do that before they move out anyway, so it may not be the motivator you think it is, especially when we're in such a strong sellers' market.
Finally, before you think that you can just reach out to owners and get something without any agent involvement, take a moment to realize you'll still need an attorney, a mortgage provider, and a deep knowledge of how to close a sale. It doesn't have to be me, but you should almost always have a broker by your side if you're buying.
What About Off-Market Rentals?
Unfortunately the one thing I can't do is create inventory where there is none. Aside from some large, luxury buildings in "less-desirable" areas and rent-controlled/stabilized units that are being intentionally given to friends/family (more on that later), landlords aren't currently holding units vacant. We just have a TON of new transplants, and people who would normally buy aren't able to because our vacancies are overpriced new dev "luxury" and co-ops (more on these things also, later). All this to say, there aren't enough rentals for the people who want them, at prices that people can comfortably afford.
If you want to find an "off-market" rental, you're going to have to do a lot of legwork. You can walk around and see if anyone has posted "for rent" signs. You can scour Craigslist (just be sure not to get scammed), Facebook groups/marketplace, and subscribe to Listings Project. You can ask your current landlord or your friends to find out about other, upcoming inventory.
Long term, if you want to solve this issue, tell your representatives that you want more non-luxury (and not ONLY affordable/income restricted; it's a "yes and" situation) housing ASAP.