Discussion about this post

User's avatar
juan ramos's avatar

I think analytics engineering's potential as a role can be systematically limited by how it's located in data teams. From my perspective, it usually sits in an ankward role between data engineering and data analytics, and that can limit the scope of what they are able to do (due to how, in order to undertand the business context, one must sit close to the business, and pretty often that role is owned by the data analytics team). It also can become a rebranding of the business intelligence usual role, not changing much beyond that.

I've been wondering how a change in the team's structure might help analytics engineers flourish. I think embedding them in teams / making them owners of certain domains is inevitable if you want them to actually go beyond being the "dbt folks" (as that's more of a consequence of them not being able to carve out an space, squeezed as they are between data engineers that own the platform and data analysts that own the answers to the business questions), however that creates a new problem to tackle, which is how you make sure the dimensional model doesn't take a hit due to lack of centralized governance.

Maybe it shouldn't be a role, but a skill expected from data engineers, although I've found many data engineers don't really care about analytics engineering per se.

Overall this post had me nodding the whole time. I wonder whether a rebranding could be useful, too. "Decision engineering" comes to mind. Logic behind is that, if we frame the role around making better decisions faster (be it through reverse ETLs, or alerting, or dashboards, or LLM bots, or metric trees, or better processes such as WBRs, or whatever), then understanding the business becomes a tool on itself, as does semantic and dimensional modeling. Nobody woud expect a "decision engineer" to just own the dimensional layer, it'd be a means to an end, just like the making of a dashboard, which would be measured against whether the problem identified around a decision has been tackled or not.

Does this resonate with you?

Matt Arderne's avatar

This is a nice articulation of what an AE does and why it wasn’t a very effective role.

I’m increasingly convinced the problem it is solving is something a software engineer would do a better job of

I also think it will prove itself to be the case, likely in DEs and AEs pushing fixes upstream

4 more comments...

No posts

Ready for more?