Dilithium wouldn't be the problem anyway, it would probably be deuterium. Those are topped up from outside in usual starship operations, because voyager isn't carrying the kind of industrial replicators that fabricate chunks of starship. It all makes sense...using energy to make energy is too entropic, it's part of why we never see phasers replicated etc.
Damn near everything in trek can be made out of anything else via replicators of a given size or complexity, the only difficulty is the amount of energy needed to be controlled and actually manipulating the matter. You probably could replicate the titanic in your quarters but it wouldn't fit out of the slot.
Then why Voyager won't replicate the industrial replicator? If you said that everything can be made by replicator, and everything can be created from the energy, then they can just build the industrial replicator in the empty space, build a shipyard, etc, out of nowhere. But they didn't. Why?
And where is the energy come from? What is the source of energy?
The point is...they don't need to do it. They choose too. Both end products could be entirely automated, but they work on artisinal products.
You can buy a model enterprise pumped out of a factory or you can buy a model made by a model maker. One is more expensive than the other because it is an artisinal product. Chateau Picard has merit because it is not from replicator, but as a means of making wine, the vineyard is no longer necessary. It is a hobby. Sisko is halfway between a chef hobbyist and a historical reenactment. (Picard's family too tbh...and look at Crushers...)
And why I saw Paris built a house on Earth with human labor? Just watch the first episode of Star Trek Voyager. Is it a hobby? Fine. Then why do they need Human Engineers on a Starship? If everything work / built automatically, then they won't need Mr. La Forge, Chief O'Brien, etc. And I won't see the team engineers enter the airduct to fix something in the TV. Yet, they still need human engineers / technician. Is it a hobby, and not a job?
Now, what is the different between a hobby and a job? A hobby is a hobby, you don't have any dedication for it. It's up to you, when you feel ok, you'll work for it, but when you don't want it, you can just ignore it. There is no obligation to do it.
So let say, I'm a tailor, and I"m doing it as a hobby. And then you come to make a suit at my shop. You need the suit for a wedding party, 5 days later. Well, I'm doing it for a hobby, not a job. So I have no obligation to you. Because you just a man who ask for help, not a customer. When I feel alright, I'll finish your suit. Buuut, I don't have any obligation to finish it for you, because that is not my job, just my hobby. If I feel that fishing is better than making a suit, then I'll leave your cloth untouched and go fishing or play game instead. Or maybe I choose to finish your suit. But why do I care with the time limit that you give to me to finish the suit? 5 days? I feel lazy. When I have the mood, I'll do it, but if not, then I'll rest. It will be lucky if your suit will finish in a month. Or if I even still have the mood to go it until the end. I don't care, go to hell with the suit. I do it for fun, not for you.
It's different if the tailor shop is my job. I have obligation to finish the job that you give to me. Because that's my job. I'll do it with full responsibility, and with professional attitude. Not because I want to, but because I have to. That is what we call a job, not a hobby.
Just imagine if Laforge or Chief O'Brien become an engineers just because of a hobby. LOL, very funny. Some broken engine? the Captain angry? Go to hell, why do they care. it just a hobby, not a job. They'll do it when their mood is right. But if not?