Nasdaq consolidated enterprise and market data on Databricks to improve governance, speed product development and support AI ...
One of the latest initiatives focuses on enabling AI agents to interact more effectively with telecom data and operational ...
The batch pipeline highlights the integration of OLTP and OLAP systems. It starts by extracting data from MongoDB, processing it using Spark, and loading it into S3 for further OLAP operations. Note: ...
In 2024, the elephant in the room was how generative artificial intelligence seized the conversation. In 2025, the dialog shifted to agents and the question of whether there’s an AI bubble happening ...
Another year passes. I was hoping to write more articles instead of just these end-of-the-year screeds, but I almost died in the spring semester, and it sucked up my time. Nevertheless, I will go ...
Every data engineering team right now is being asked the same question: "How do we build a chatbot that talks to our data?" The prototypes are deceptively simple. A developer connects GPT-5.1 to a ...
The dbt-databricks adapter contains all of the code enabling dbt to work with Databricks. This adapter is based off the amazing work done in dbt-spark. Some key features include: If you are developing ...