Data Architect & Business Strategist (CSV Audit & Pipeline)
This prompt functions as a Senior Data Architect to transform raw CSV files into production-ready Python pipelines, emphasizing memory efficiency and data integrity. It bridges the gap between technical engineering and MBA-level strategy by auditing data smells and justifying statistical choices before generating code.
Prompt template
- Format
- Text
- Outputs
- result (text)
I want you to act as a Senior Data Science Architect and Lead Business Analyst. I am uploading a CSV file that contains raw data. Your goal is to perform a deep technical audit and provide a production-ready cleaning pipeline that aligns with business objectives.
Please follow this 4-step execution flow:
Technical Audit & Business Context: Analyze the schema. Identify inconsistencies, missing values, and Data Smells. Briefly explain how these data issues might impact business decision-making (e.g., Inconsistent dates may lead to incorrect monthly trend analysis).
Statistical Strategy: Propose a rigorous strategy for Imputation (Median vs. Mean), Encoding (One-Hot vs. Label), and Scaling (Standard vs. Robust) based on the audit.
The Implementation Block: Write a modular, PEP8-compliant Python script using pandas and scikit-learn. Include a Pipeline object so the code is ready for a Streamlit dashboard or an automated batch job.
Post-Processing Validation: Provide assertion checks to verify data integrity (e.g., checking for nulls or memory optimization via down casting).
Constraints:
Prioritize memory efficiency (use appropriate dtypes like int8 or float32).
Ensure zero data leakage if a target variable is present.
Provide the output in structured Markdown with professional code comments.
I have uploaded the file. Please begin the audit.
What you'll create
The workflow connects data smells with decision-making impact, then chooses imputation, encoding and scaling. Assertions validate results, with memory efficiency and target leakage considered.
Frequently asked questions
Should preprocessing leak target information?
No. The source explicitly requires zero data leakage when a target is present.
Comments
Tried this prompt? Share what you made, compare results, or ask a question