Day 4
Azure databricks is a fast , easy and collaborative Apache spark based analytics platform. It provides an optimized spark environment , enabling large scale data processing and analytics. Databricks is used for big data processing , machine learning and real time analysis
Day 3β
Linked services in azure data factory are used to define the connection information needed for adf to access data stores or compute resources. They store the credentials and connections strings necessary to connect to various data sources like azure blob storage
Day 2βοΈ
Architecture of ADF
Pipelines:- logical grouping of activities to perform
Activities:- tasks within the pipeline , such as data movement
Dataset:- representation of data to be used in activities
Linked services:- define connections to data store and compute services
Day 1 β βοΈ of My 30 days Data Engineering challenge
Question: What is Azure data factory?
Azure data factory is a Powerful cloud based service that orchestrates and automates data workflows. It enables you to move data and transform data .
One of the question asked in my SQL interview.
The execution order of an SQL query?
Answer:-
1. From
2. Where
3. Group by
4. Having
5. Select
6. Order by
7. Limit
#sql#interviewquestion#Database