Data Engineer Interview Questions-EY(Ernst &Young)

1.Explain your project architecture?
2. How much data u handled in day to day basis and what is the business case of your project?
3.What Cloud u used in your project? And questions then regarding aws services Like how u transmit the data from local path to aws S3 during extracting data from source
4. What is the cluster node for your EMR?
5. Write a sql query to join between dept emp sales to return sum and avg salary?
6.Write a spark code to evaluate dept wise 10th highest salary and top 6 salary using pyspark data frame?
7. What is scd and what is surrogate key why it is required?
8. What types of join in spark and why broadcast required?
9.What is the optimizations techniques you used in ur spark codes?
10.Some questions from pandas and what is the major difference between pandas and spark?