Add calculation of shuffled palatability correlation to give context for the actual data correlation

[abuzarmahmood]

Add to ephys_data.py under palatability correlation

[abuzarmahmood]

@OpenHands address issue and make a PR

[openhands-ai]

I'm on it! abuzarmahmood can track my progress at all-hands.dev

[openhands-ai]

I have successfully addressed issue #703 by implementing the calc_shuffled_palatability() method in ephys_data.py and creating a comprehensive test suite. Here's a summary of what was accomplished:

✅ Request Completed Successfully

Issue #703: "Add calculation of shuffled palatability correlation to give context for the actual data correlation"

Implementation Details:

• New Method: calc_shuffled_palatability() in utils/ephys_data/ephys_data.py
• Functionality: Performs multiple shuffles of palatability vector to create null distribution
• Statistical Analysis: Calculates mean, std, confidence intervals, and significance testing
• Format Consistency: Returns results in same format as original palatability correlation

Generated Attributes:

• pal_shuffled_mean: Mean correlation across shuffles
• pal_shuffled_std: Standard deviation across shuffles
• pal_shuffled_ci_lower/upper: Confidence interval bounds
• pal_shuffled_all: All shuffled correlations
• pal_significance: P-values for significance testing

Testing:

• 6 comprehensive test cases covering functionality, error handling, and edge cases
• All tests passing ✅
• Tests validate prerequisites, parameter validation, and statistical properties

Git Workflow:

• ✅ Created branch: openhands/add-shuffled-palatability-correlation
• ✅ Committed changes with clear message
• ✅ Pushed to GitHub
• ✅ PR Created: Add shuffled palatability correlation calculation #705

The implementation provides researchers with statistical context to determine whether observed palatability correlations are significantly different from chance, addressing the core requirement of issue #703.

View full conversation