Data Engineering Resources
Getting Started
A Beginner’s Guide to Data Engineering — Part I
1 year of must-read data engineering articles
https://www.dataengineeringweekly.com/
Engineering Management
Production Oriented Development
Awesome Engineering Management. Pointers and tools for learning and day-to-day practice of engineering management & leadership.
Principled Data Engineering, Part I: Architectural Overview. The first of a two part series exploring the fundamental themes of architecting and governing a data lake
Great Expectations
Great Expectations helps data teams eliminate pipeline debt, through data testing, documentation, and profiling.
Towards Data Science: Validate what you expect from your data before it runs into some analysis
Document Analysis as Python Code with Great Expectations
Maximizing Productivity of Analytics Teams Part 3: Pipeline Tests & Great Expectations. In data work, productivity and analytical integrity are two faces of the same coin. If you make one better, the other is improved in parallel. Pipeline tests are an automated way to manage complexity, contributing to the efficiency of the analytics team.
Misc
Bare-Bones Notification Solutions in Python. How we get notifications from applications, data pipelines, or running processes as conveniently as possible.