An example repository for using with Ingenii's Azure Data Platform Databricks Runtime. You should clone this into your own Azure DevOps repository and add your data-specific configuration to integrate with Ingenii's Azure Data Platform.
Here we keep a record of the required settings to ignest raw data into your data platform, which are contained in these folders:
dbt: Configuration for the Databricks tables and source data files: Understanding_and_Ingesting_Data.mdpre_process: Python code to prepare raw files to be ingested by the data platform. For example, these could rewrite a JSON file returned by an API that needs to be converted to a.csv: Pre_Processing.md