Netflix Pipeline/ ├── adf/ ├── databricks/ │ ├── bronze/ # Ingestion notebooks — raw data landing │ ├── silver/ # Transformation notebooks — cleansed layer │ ├── gold/ # Aggregation notebooks — ...
A cross tenant metadata driven processing framework for Azure Data Factory and Azure Synapse Analytics achieved by coupling orchestration pipelines with a SQL database and a set of Azure Functions.