I'm working with UK Biobank data. I made a cohort with the Cohort Browser and tried to extract the data with this code
df = participant.retrieve_fields(names=field_names, filter_sql = cohort.sql, coding_values = "replace", engine=dxdata.connect()).
This is part of the text of the error:
Py4JJavaError: An error occurred while calling 04100.showString. org.apache.spark. SparkException: Exception thrown in awaitResult:. The full error message is cut off.
However, if I remove the filter -
df = participant.retrieve_fields(names=field_names, coding_values = "replace", engine=dxdata.connect()) – there is no issue.
What kind of error is this and why would filtering for a cohort help?