1. Utilizing the Bay Area Bike Share database (both Year 1 & 2, Aug. 2013- Aug. 2015)- what is the most popular start station based on trip data? Embarcadero at Sansome Market at 4th San Francisco Caltrain Townsend at 7th -- Run this in HIVE Editor -- SELECT startterminal, startstation, COUNT(1) AS count FROM bay_area_bike_share GROUP BY startterminal, startstation ORDER BY count DESC LIMIT 10 2. Utilizing the Bay Area Bike Share database (Year 1 only, Aug. 2013- Feb 2014) - Which is the least popular(least used) start station in the Bike share trips data? (Hint: Use the count of start station, group and order in ascending order) Townsend at 7th Mezes Park Market at 4th Embarcadero at Sansome -- Run this in HIVE Editor -- SELECT startstation, COUNT(1) AS count FROM bay_area_bike_share GROUP BY startstation ORDER BY count ASC LIMIT 10 3. Utilizing the Bay Area Bike Share database (for Year 1 on...
UNIX ASSIGNMENTS: Day 1 Concept : Basic commands in UNIX, Filters, Pipes Objective : Participant will be able to: · Execute Basic Unix commands · Implement the concepts of Pipes and Filters · Work with vi editor Problems: Section 1: 1. List all the files and sub directories of the directory /bin. 2. List all the files including hidden files in your current directory. 3. List all the files starting with letter ‘r’ in your current directory. 4. List all the files having three characters in their names, from your current directory. 5. List all the files with extension ‘.doc’ in your current directory. 6. ...
HDFS performance,tuning, and robustness 5 questions 1. Name the configuration file which holds HDFS tuning parameters mapred-site.xml core-site.xml hdfs-site.xml 2. Name the parameter that controls the replication factor in HDFS dfs.block.replication dfs.replication.count dfs.replication replication.xml 3. Check answers that apply when replication is lowered HDFS is less robust Less likely that data will be local to more workers Aggregate I/O rate will be worse HDFS will have more space available 4. Check answers that apply when NameNode fails to receive heartbeat from a DataNode DataNode is marked dead NameNode will attempt to restart DataNode No new I/O is sent to particular DataNode that missed heartbeat check Blocks below replication factor are re...
Comments
Post a Comment