{"aiPlatform":"claude-code@2025.06","category":"data-analysis","commandName":"/data-validation","content":"---\nname: Data Validation Pipeline\ndescription: Create comprehensive data validation systems with schema validation, quality checks, and automated monitoring for data integrity.\nallowed_tools:\n  - filesystem      # Access data files and validation schemas\n  - memory          # Track validation patterns and data quality metrics\n  - sqlite          # Store validation results and quality reports\ntags:\n  - data-validation\n  - data-quality\n  - schema-validation\n  - data-integrity\n  - monitoring\ncategory: development\nversion: 1.0.0\nauthor: AI Commands Team\n---\n\n# Data Validation Pipeline\n\nCreate a comprehensive data validation system for: $ARGUMENTS\n\nImplement validation including:\n\n1. **Schema Validation**:\n   - Pydantic models for structure\n   - JSON Schema generation\n   - Type checking and coercion\n   - Nested object validation\n   - Custom validators\n\n2. **Data Quality Checks**:\n   - Null/missing value handling\n   - Outlier detection\n   - Statistical validation\n   - Business rule enforcement\n   - Referential integrity\n\n3. **Data Profiling**:\n   - Automatic type inference\n   - Distribution analysis\n   - Cardinality checks\n   - Pattern detection\n   - Anomaly identification\n\n4. **Validation Rules**:\n   - Field-level constraints\n   - Cross-field validation\n   - Temporal consistency\n   - Format validation (email, phone, etc.)\n   - Custom business logic\n\n5. **Error Handling**:\n   - Detailed error messages\n   - Error categorization\n   - Partial validation support\n   - Error recovery strategies\n   - Validation reports\n\n6. **Performance**:\n   - Streaming validation\n   - Batch processing\n   - Parallel validation\n   - Caching strategies\n   - Incremental validation\n\n7. **Integration**:\n   - API endpoint validation\n   - Database constraints\n   - Message queue validation\n   - File upload validation\n   - Real-time validation\n\nInclude data quality metrics, monitoring dashboards, and alerting. Make it extensible for custom validation rules.","contentHash":"778b71ddd79ca3927696ce6577294aea27ab3ccf85e0f2130404067f2c41ab22","copies":0,"createdAt":"2025-08-12T16:09:37.393Z","description":"Implement comprehensive data validation systems","github":{"repoUrl":"https://github.com/Commands-com/commands","lastSyncDirection":"from-github","metadata":{"importedFrom":"github_repository","repoPrivate":false,"repoDefaultBranch":"main","connectedAt":"2025-08-12T16:09:37.393Z"},"importedAt":"2025-08-12T16:09:37.393Z","lastSyncAt":"2025-08-17T17:57:48.644Z","fileMapping":{"license":null,"readme":null,"assets":[],"mainFile":"tools/data-validation.md"},"selectedCommand":"data-validation","fileShas":{"mainFile":"99b303fd08f51088934d631243b01b4f35197326","yamlPath":"313647b1fb381389da33b7913e95baf617c4b392"},"branch":"main","connectionType":"commands_yaml","connected":true,"lastSyncCommit":"01591bc061d236bde47bf23b0f47e8afcf1a5144","importSource":"repository_import","installationId":"69232615","syncStatus":"synced"},"githubRepoUrl":"https://github.com/Commands-com/commands","id":"239d56e2-8cab-4748-9c63-60f2a69a4265","inputParameters":[{"defaultValue":"great-expectations","name":"validation_framework","options":["great-expectations","pandera","pydantic","cerberus","jsonschema","custom"],"description":"Data validation framework to use","label":"Validation Framework","type":"select","required":false}],"instructions":"Implement comprehensive data validation systems","likes":0,"mcp_search_content":"","organizationUsername":"commands-com","price":"free","search_content":"data validation implement comprehensive data validation systems /data-validation data-analysis claude-code@2025.06","title":"Data Validation","type":"command","updatedAt":"2025-08-17T17:57:48.644Z","userId":"W0V8NAw5AhWRwcuwSoFLOi1Yem83","visibility":"public","name":"data-validation","userInteraction":{"userHasStarred":false}}