You are viewing a single thread.
View all comments View context
42 points

Your knowledge of data engineering may be limited. SQL is predominant in data processing nowadays. FOSS tools such as DBT allows to write efficient data processing pipelines with SQL and some YAML config without the need for a general purpose coding language.
Why would anyone want that? Because SQL has the interesting property of describing the result you want rather than describing how to compute it. So you can put inside the database, a query engine with decades of optimizations, that will make a much better job at finding the best execution plan than the average developer.
It also means itโ€™s easier to train people for data processing nowadays.

permalink
report
parent
reply
3 points

Learning DBT was pretty easy for me as a data analyst. Now Iโ€™m contributing to my companyโ€™s data warehouse instead of just pulling existing data.

permalink
report
parent
reply

Programmer Humor

!programmerhumor@lemmy.ml

Create post

Post funny things about programming here! (Or just rant about your favourite programming language.)

Rules:

  • Posts must be relevant to programming, programmers, or computer science.
  • No NSFW content.
  • Jokes must be in good taste. No hate speech, bigotry, etc.

Community stats

  • 4.1K

    Monthly active users

  • 1.5K

    Posts

  • 35K

    Comments