Your husband is from China, let's keep things straight. That will clearly be what matters here, and what all documents say.
For quite a while, (almost all) refugees from China are NOT given real refugee status but only the temporary version (similar to what Eritreans are getting nowadays, for example) - that is "Vorläufig aufgenommen", ie temporary/for the time being accepted.
https://www.fluechtlingshilfe.ch/asy...uslaender.html
Real refugees get status B quite quickly, and a path to Swiss cizitenship, eventually (of course, integrate themselves properly being mandatory)
After 5 years on F status (being renewed yearly) he can claim "Härtefallgesuch" which could be leading to B Ausweis eventually.
Before that, it's possible to ask for family reunification after 3 years:
Ehegatten und ledige Kinder unter 18 Jahre von vorläufig aufgenommenen Personen ist der Familiennachzug frühestens drei Jahre nach der Gewährung der vorläufigen Aufnahme möglich. Voraussetzung ist, dass alle im gleichen Haushalt leben, die Familie über eine geeignete Wohnung verfügt und nicht von der Sozialhilfe abhängig ist (Art. 85 Abs. 7 AuG). Das Gesuch ist an die betreffende kantonale Migrationsbehörde zu richten, die es an das SEM weiterleitet. Für das Gesuch gelten bestimmte Fristen (Art. 74 Abs. 2 und 3 VZAE).
That means, he needs to have a steady job making him not being on social benefits, a flat big enough, and the whole request must still be approved (ie, it's far from being automatically granted)
So basically:
He needs to have a job paid enough to support the whole family (and a big enough flat), holding it for a while. Then he can apply for it. Which will take quite a while.
I think you being pregnant will make things more complicated. Even IF he holds a steady job that will definitely add some checks/time.