Pip Install Requirements.txt issue

I have problems installing the requirements.txt file inside docker. I get "
Installing collected packages: six, python-dateutil, pytz, pandas
  Running setup.py install for pandas: started
    Running setup.py install for pandas: finished with status 'error'

This can be fixed by having "RUN pip install pandas" and "RUN pip install numpy" in the dockerfile. This seems to be known pip issue.