Posts

Showing posts from March, 2017

Big Data Workshop - 10 - Spark aggregateByKey and groupByKey

Image

Big Data Workshop - 09 - Spark - Writing Spark apps using Scala - Comput...

Image

Big Data Workshop - 08 - Spark - Writing Spark applications using Scala ...

Image

Big Data Workshop - 07 - Spark - HDFS Briefly

Image

Big Data Workshop - 06 - Spark - using sbt and eclipse, spark job execut...

Image

Chapter-4:Spark and Scala Getting started - word count program

Image

Chapter-3:Spark and Scala JDBC programming and typesafe config

Image

Chapter-2:Spark and Scala

Image

Chapter-1:Spark and Scala

Image

Hadoop Introduction - HDP - Map Reduce and Hive demo

Image

HIve Interview Questions

1. What is a map join in hive 2. UDF? 3. Distinct- how is it used in hive? Is there any other way to get the ‘distinct’ done without using the key word? 4. What is metastore? 5. Where we can get the information of a metastore. 6. What is parameter in hive-site.xml which corresponds to metastore configuration? 7. If you have 10 different user and you want to change the metastore for one user, how you can do that? 8. Suppose you have data from Jan to Dec and one month data is corrupted, what strategies would you use so that your existing clean data need not be uploading again? 9. What is dynamic partitioning? 10. What is the restriction on dynamic partitioning (strict mode - non-strict mode?). 11. Default value per node of number of dynamic partition supported. 12. What is rlike? 13. External table and manage table. 14. What if you have to create a manage table from external table, what would happen to the data (data will move or copy). 15. Can we cha...