A data-centric pipeline platform that provides Git-like version control for large-scale datasets. It automates data lineage and re-computes only the necessary parts of a pipeline when data changes.
Tech Stack
GoAI, ML & Data
Why pachyderm?
• Immutable data lineage
• Language-agnostic pipelines
• Efficient incremental processing
Limitations
• Requires Kubernetes
• High operational complexity
• Resource intensive
3/3/2026
Last Update
568
Forks
938
Issues
Apache-2.0
License
Financial Leak Detected
Stop the "SaaS Tax"
Your team could be burning cash. Switching to pachyderm instantly boosts your runway.
