List: Data Engineering | Curated by Aaron Berry

Jul 9, 2022
12 stories
Data EngineeringBuilding software to move and make data was dirty than it was before! (Hopefully)
In
GRID
by
Hjalmar Gislason
We built a spreadsheet engine from scratch. Here’s what we learned.From the very beginning, one of the core ideas behind GRID has been that spreadsheets — and spreadsheet models in particular — can be made…
Jun 28, 2022
7
Jun 28, 2022
7
In
Python in Plain English
by
Yancy Dennis
Python 3.11 to be Twice as Fast as its PredecessorsThe upcoming version of Python is set to be twice as fast as the previous versions.
Mar 28, 2022
10
Mar 28, 2022
10
In
The Dev Project
by
Felipe F Garcia
The single most useful Python Decorator @cacheHow a simple decorator can speed your code recursion for more than 10x
Nov 10, 2021
8
Nov 10, 2021
8
In
Towards Data Science
by
Zita
7 Data Science Projects You Should Do to Make Your Resume Stand OutData Science projects that will help you land your dream job
Jan 4, 2022
17
Jan 4, 2022
17
In
Towards Data Science
by
Dimitris Poulopoulos
Jenkins for CI Is Dead: Why Do People Hate It and What’s the Alternative?How to automatically build your Docker images; a case study.
Jun 24, 2021
21
Jun 24, 2021
21
In
Towards Data Science
by
Terence Shin, MSc, MBA
Five of the Best Data Science Projects from 2021A Curated List of the Best Kaggle Notebooks from 2021
Nov 11, 2021
1
Nov 11, 2021
1
In
Level Up Coding
by
Aaron Berry
Airflow DAG and Task Markdown DocsI’ll cover how you can use markdown to document your Airflow DAGs and tasks using doc_md inline with your current Airflow code.
Dec 10, 2021
1
Dec 10, 2021
1
Safouene Raddaoui
Best Practices for using Docker in Production
Nov 13, 2021
Nov 13, 2021
In
Better Programming
by
Ashley Peacock
7 Fabulous Books For Aspiring Software Engineers and ArchitectsIncrease your breadth of knowledge with these major engineering topics
Dec 2, 2021
8
Dec 2, 2021
8
In
Towards Data Science
by
Antony Henao
Data Engineers Shouldn’t Write Airflow Dags — Part 2A framework proposal for Apache Airflow
Jun 16, 2021
3
Jun 16, 2021
3
In
The Startup
by
Amit Singh Rathore
Airflow DAG — Best PracticesIn the blog post, we will see some best practices for authoring DAGs. Let’s start.
Feb 23, 2021
4
Feb 23, 2021
4
Chandu Kavar
Testing in Airflow Part 1 — DAG Validation Tests, DAG Definition Tests and Unit TestsTesting is an integral part of any software system to build confidence and increase the reliability of the system. Recently, I joined Grab…
Aug 18, 2018
22
Aug 18, 2018
22