Azure Data Engineer Interview Questions & Answers
Azure Data Engineer Interview Questions 1. What are the best practices for managing and optimizing storage costs in ADLS? Use storage tiers – Hot, Cool, Archive based on access frequency. Enable lifecycle policies – Auto-move or delete old data. Use compressed formats – Like Parquet or Avro. Avoid small files – Merge to reduce overhead. Clean up unused data – Delete temp or obsolete files. Monitor with Cost Management – Set budgets and alerts. Use hierarchical namespace – For efficient file handling. 2. How do you implement security measures for data in transit and at rest in Azure? Security measures in Azure: Data in Transit : Use TLS encryption (enabled by default). Use private endpoints and VPNs for secure connections. Data at Rest : Use Azure Storage Service Encryption (SSE) (enabled by default). Enable Azure Disk Encryption for VMs. Use customer-managed keys (CMK) for a...