For some reason FME Custom Python interpreter only referred to my base Anaconda environment, even with PYTHONPATH and dll in a different environment. Still no idea why.. But worked around by installing necessary packages in my base environment. Not perfect, but it does the job.