--

Nice list of tools.

However, the choice of each of those tools and components sometimes is tricky and depends on the needs. Basically, a Data Engineer project is not a final goal, it's the first step in a global project of making a value from data, using data science, or making data available in some way. This conditions the choice of each component. Unfortunately, and didn't see this discussion in your article, and I think it's could be interesting.

--

--

Abdelkader Rhouati

Data scientist & Ph.D. researcher on AI. My area of expertise is around Deep Learning, NLP, and XAI