List: Data Engineering | Curated by Aaron Berry

Jul 9, 2022
12 stories
Data EngineeringBuilding software to move and make data was dirty than it was before! (Hopefully)
Hjalmar Gislason
in
GRID
We built a spreadsheet engine from scratch. Here’s what we learned.From the very beginning, one of the core ideas behind GRID has been that spreadsheets — and spreadsheet models in particular — can be made…
Jun 28, 2022
7
Jun 28, 2022
7
Yancy Dennis
in
Python in Plain English
Python 3.11 to be Twice as Fast as its PredecessorsThe upcoming version of Python is set to be twice as fast as the previous versions.
Mar 28, 2022
11
Mar 28, 2022
11
Felipe F Garcia
in
The Dev Project
The single most useful Python Decorator @cacheHow a simple decorator can speed your code recursion for more than 10x
Nov 10, 2021
8
Nov 10, 2021
8
Zita
in
Towards Data Science
7 Data Science Projects You Should Do to Make Your Resume Stand OutData Science projects that will help you land your dream job
Jan 4, 2022
17
Jan 4, 2022
17
Dimitris Poulopoulos
in
Towards Data Science
Jenkins for CI Is Dead: Why Do People Hate It and What’s the Alternative?How to automatically build your Docker images; a case study.
Jun 24, 2021
21
Jun 24, 2021
21
Terence Shin, MSc, MBA
in
Towards Data Science
Five of the Best Data Science Projects from 2021A Curated List of the Best Kaggle Notebooks from 2021
Nov 11, 2021
1
Nov 11, 2021
1
Aaron Berry
in
Level Up Coding
Airflow DAG and Task Markdown DocsI’ll cover how you can use markdown to document your Airflow DAGs and tasks using doc_md inline with your current Airflow code.
Dec 10, 2021
1
Dec 10, 2021
1
Safouene Raddaoui
Best Practices for using Docker in Production
Nov 13, 2021
Nov 13, 2021
Ashley Peacock
in
Better Programming
7 Fabulous Books For Aspiring Software Engineers and ArchitectsIncrease your breadth of knowledge with these major engineering topics
Dec 2, 2021
8
Dec 2, 2021
8
Antony Henao
in
Towards Data Science
Data Engineers Shouldn’t Write Airflow Dags — Part 2A framework proposal for Apache Airflow
Jun 16, 2021
3
Jun 16, 2021
3
Amit Singh Rathore
in
The Startup
Airflow DAG — Best PracticesIn the blog post, we will see some best practices for authoring DAGs. Let’s start.
Feb 23, 2021
4
Feb 23, 2021
4
Chandu Kavar
Testing in Airflow Part 1 — DAG Validation Tests, DAG Definition Tests and Unit TestsTesting is an integral part of any software system to build confidence and increase the reliability of the system. Recently, I joined Grab…
Aug 18, 2018
22
Aug 18, 2018
22