Per the BigMapAbstraction Taquito API docs, there isn't a way to fetch all the values in that map.
Is the suggested way to fetch all of values in the map by doing batch queries on it then? Or what's the recommended way to fetch these values?
You have 2 solutions for this problem:
map when you will have many items. Otherwise, your contract will get gas locked easily.