[{"id":"85189ab3-01e1-4c77-9b48-22c8998eec0a","public":true,"title":"Statistical Hypothesis Testing","description":"For machine learning practicals","created_at":"2025-12-16T13:04:03.932903","updated_at":"2025-12-19T06:31:57.058687","user_id":{"id":"7f19022d-7f7a-4f28-9eef-f4d8f0475bc8","quizs":[{"id":"85189ab3-01e1-4c77-9b48-22c8998eec0a","public":true,"title":"Statistical Hypothesis Testing","description":"For machine learning practicals","created_at":"2025-12-16T13:04:03.932903","updated_at":"2025-12-19T06:31:57.058687","user_id":{"id":"7f19022d-7f7a-4f28-9eef-f4d8f0475bc8"},"questions":[{"question":"You are training a Linear Regression model (y = a + b · y). You want to test if the feature “House_Size” has any impact on the target “Price”. What is the correct Null Hypothesis? ","time":"80","type":"ABCD","answers":[{"right":true,"answer":"H0: b=0","color":"#D6EDC9"},{"right":false,"answer":"H0: b!=0","color":"#B07156"},{"right":false,"answer":"H0: b>0","color":"#7F7057"},{"right":false,"answer":"H0: b<0","color":"#4E6E58"}],"image":"e6df782d-a82f-488c-9826-ee9528708363","hide_results":false},{"question":"You have a baseline model with 85% accuracy. You want to prove your new model is statistically better. Which set of hypotheses is correct?","time":"80","type":"ABCD","answers":[{"right":false,"answer":"H0: μ=0.85 vs. H1: μ!=0.85","color":"#D6EDC9"},{"right":false,"answer":"H0: The model achieves consciousness.","color":"#B07156"},{"right":true,"answer":"H0: μ≤0.85 vs. H1: μ>0.85","color":"#7F7057"},{"right":false,"answer":"H0: μ>0.85 vs. H1: μ≤0.85","color":"#4E6E58"}],"image":"bae26cf3-9ce5-4436-974a-e874fc4bdfff","hide_results":false},{"question":"You are A/B testing a new “Buy” button color at significance level α = 0.05. You get resulting p-value 0.03. How will you decide?","time":"80","type":"ABCD","answers":[{"right":false,"answer":"Accept H0. The colors perform identically.","color":"#D6EDC9"},{"right":true,"answer":"Reject H0. The color change made a significant difference.","color":"#B07156"},{"right":false,"answer":"Fail to reject H0. The difference is just noise.","color":"#7F7057"},{"right":false,"answer":"No idea, just make the button invisible.","color":"#4E6E58"}],"image":"34102e84-278c-4b4b-87d4-6d06711f0e44","hide_results":false},{"question":"You are building a mission-critical AI for a nuclear reactor. You need to be extremely sure before you change any settings. Which α value do you choose?","time":"60","type":"ABCD","answers":[{"right":false,"answer":"α=1.00","color":"#D6EDC9"},{"right":false,"answer":"α=0.10","color":"#B07156"},{"right":false,"answer":"α=0.05","color":"#7F7057"},{"right":true,"answer":"α=0.01","color":"#4E6E58"}],"image":"f983ecd6-e6dc-447d-be70-b66c479c80e1","hide_results":false},{"question":"A firewall fails to identify a virus and lets it in. What type of error is this?","time":"60","type":"ABCD","answers":[{"right":false,"answer":"Type I","color":"#D6EDC9"},{"right":true,"answer":"Type II","color":"#B07156"}],"image":"34d3e951-c2dd-49ee-a9a5-dbdcfa09f97c","hide_results":false},{"question":"Which of the following are examples of a Type I Error?","time":"80","type":"CHECK","answers":[{"right":true,"answer":"Medical test saying you are sick when you are healthy.","color":"#D6EDC9"},{"right":false,"answer":"Spam filter marking a spam as real email.","color":"#B07156"},{"right":true,"answer":"FaceID unlocking your phone for a stranger.","color":"#7F7057"},{"right":false,"answer":"Your code running without errors on the first try.","color":"#4E6E58"}],"image":"03d27019-4bb6-45fd-9597-f8c5a71c97da","hide_results":false},{"question":"What does a p-value of 0.03 mean?","time":"60","type":"ABCD","answers":[{"right":false,"answer":"There are 3% of errors in the dataset.","color":"#D6EDC9"},{"right":false,"answer":"The model is 3% accurate.","color":"#B07156"},{"right":false,"answer":"The result is 97% correct.","color":"#7F7057"},{"right":true,"answer":"There is a 3% chance the result happened by random chance assuming the Null is true.","color":"#4E6E58"}],"image":"a9779386-606a-49ff-9626-936be203339d","hide_results":false},{"question":"You are building an AI for autonomous braking. H0: no obstacle. False Negative: car does not stop while seeing an obstacle. False positive: The car brakes for a shadow. How do you adjust α to make the car safer?","time":"80","type":"ABCD","answers":[{"right":true,"answer":"Increase α, Type I error increases, Type II error decreases","color":"#D6EDC9"},{"right":false,"answer":"Increase α, Type I error decreases, Type II error increases","color":"#B07156"},{"right":false,"answer":"Decrease α, Type I error decreases, Type II error increases","color":"#7F7057"},{"right":false,"answer":"Decrease α, Type I error increases, Type II error decreases","color":"#4E6E58"}],"image":"923adbe9-182a-4f66-a95f-f7f2783cd0e4","hide_results":false},{"question":"You get a p-value of 0.04. This means there is a 96% probability that the Alternative Hypothesis is true.","time":"40","type":"ABCD","answers":[{"right":false,"answer":"True","color":"#D6EDC9"},{"right":true,"answer":"False","color":"#B07156"}],"image":"25e74624-6e8e-46f3-a2af-fae5cd09cebb","hide_results":false},{"question":"Slide","time":"120","type":"SLIDE","answers":"{\"stage\":{\"attrs\":{\"width\":1520,\"height\":805,\"x\":0,\"y\":0},\"filters\":[],\"className\":\"Stage\"},\"layer\":{\"attrs\":{\"x\":0,\"y\":0,\"width\":1520,\"height\":805},\"filters\":[],\"className\":\"Layer\"},\"background\":{\"image\":{\"attrs\":{\"x\":0,\"y\":0},\"filters\":[],\"className\":\"Image\",\"zIndex\":0},\"overlay\":{\"attrs\":{\"className\":\"Rect\",\"x\":0,\"y\":0},\"filters\":[],\"className\":\"Rect\",\"zIndex\":1}},\"shapes\":[{\"attrs\":{\"x\":321,\"y\":271,\"width\":989.4,\"scaleY\":0.999999999999999,\"height\":122},\"filters\":[],\"className\":\"Label\",\"zIndex\":3,\"children\":[{\"attrs\":{\"width\":989.399993896487,\"height\":122,\"scaleX\":0.999999999999999},\"className\":\"Tag\"},{\"attrs\":{\"text\":\"Statistical tests\",\"fontSize\":\"122\",\"fill\":\"black\",\"height\":\"auto\",\"width\":989.399993896487,\"scaleX\":0.999999999999999},\"className\":\"Text\"}]}]}","image":null,"hide_results":false},{"question":"You trained a model to detect fake product reviews. You want to check if the categorical feature “Review Platform” (Amazon, eBay, Etsy) is independent of the model’s prediction (Fake, Genuine). Which statistical test do you use?","time":"70","type":"ABCD","answers":[{"right":false,"answer":"Z-test","color":"#D6EDC9"},{"right":false,"answer":"Pearson Correlation Coefficient ","color":"#B07156"},{"right":false,"answer":"Student’s T-test","color":"#7F7057"},{"right":true,"answer":"Chi-Square Test of Independence","color":"#4E6E58"}],"image":"a7ce808b-18ea-4391-9b6e-cc083d2a0d58","hide_results":false},{"question":"Comparing the average salary of Data Scientists vs. Software Engineers. You survey 100 random people from each job. Which test is appropriate?","time":"70","type":"ABCD","answers":[{"right":false,"answer":"Paired T-test","color":"#D6EDC9"},{"right":false,"answer":"One-Sample Z-test","color":"#B07156"},{"right":true,"answer":"Independent Two-Sample T-test","color":"#7F7057"},{"right":false,"answer":"A coding battle","color":"#4E6E58"}],"image":"25202e12-b7f8-4938-bfcf-ddef7c4e4fd9","hide_results":false},{"question":"You want to test if data augmentation improves model accuracy. You train a model on Dataset 1 (with aug) and Dataset 1 (without aug). You repeat this for all 20 datasets. Which test is appropriate?","time":"70","type":"ABCD","answers":[{"right":true,"answer":"Paired T-test","color":"#D6EDC9"},{"right":false,"answer":"The Turing Test","color":"#B07156"},{"right":false,"answer":"Independent Two-Sample T-test","color":"#7F7057"},{"right":false,"answer":"Chi-Square Test","color":"#4E6E58"}],"image":"4f8f1786-de05-4440-9ca2-446763efd519","hide_results":false},{"question":"When do you use a T-test instead of a Z-test?","time":"60","type":"ABCD","answers":[{"right":true,"answer":"When sample size is small.","color":"#D6EDC9"},{"right":false,"answer":"When sample size is huge.","color":"#B07156"},{"right":false,"answer":"When data is categorical.","color":"#7F7057"},{"right":false,"answer":"When you lost your Z-table.","color":"#4E6E58"}],"image":"1f7fdbdc-2564-4801-9ed3-23a1012a12ce","hide_results":false},{"question":"You test 1,000 random features against a target with α=0.05. How many features will likely appear significant purely by chance?","time":"40","type":"ABCD","answers":[{"right":false,"answer":"0","color":"#D6EDC9"},{"right":false,"answer":"5","color":"#B07156"},{"right":true,"answer":"50","color":"#7F7057"},{"right":false,"answer":"500","color":"#4E6E58"}],"image":"ccb10a04-24f4-433f-a4bf-799b1f70eca8","hide_results":false},{"question":"What is the Multiple Comparison Problem?","time":"80","type":"ABCD","answers":[{"right":false,"answer":"The statistical requirement to double your sample size for every new variable you add.","color":"#D6EDC9"},{"right":false,"answer":"When your dataset has too many duplicate rows.","color":"#B07156"},{"right":false,"answer":"When the features in your dataset are too similar to each other.","color":"#7F7057"},{"right":true,"answer":"Running many tests increases the chance of getting a \"significant\" result just by luck.","color":"#4E6E58"}],"image":"10736eb4-5721-476b-b77c-707affef3b66","hide_results":false},{"question":"You are doing a Grid Search with many tests. How do you fix the Multiple Comparison Problem?","time":"60","type":"ABCD","answers":[{"right":false,"answer":"Increase α to 0.5","color":"#D6EDC9"},{"right":true,"answer":"Use the Bonferroni Correction (lower the α)","color":"#B07156"},{"right":false,"answer":"Just ignore the p-values","color":"#7F7057"},{"right":false,"answer":"Use the Bonaparte Correction (increase the α)","color":"#4E6E58"}],"image":"bf5b937d-70b8-473a-b518-a5f7c5eb72c0","hide_results":false}],"imported_from_kahoot":false,"cover_image":null,"background_color":null,"background_image":null,"kahoot_id":null,"likes":0,"dislikes":0,"plays":8,"views":27,"mod_rating":null}]},"questions":[{"question":"You are training a Linear Regression model (y = a + b · y). You want to test if the feature “House_Size” has any impact on the target “Price”. What is the correct Null Hypothesis? ","time":"80","type":"ABCD","answers":[{"right":true,"answer":"H0: b=0","color":"#D6EDC9"},{"right":false,"answer":"H0: b!=0","color":"#B07156"},{"right":false,"answer":"H0: b>0","color":"#7F7057"},{"right":false,"answer":"H0: b<0","color":"#4E6E58"}],"image":"e6df782d-a82f-488c-9826-ee9528708363","hide_results":false},{"question":"You have a baseline model with 85% accuracy. You want to prove your new model is statistically better. Which set of hypotheses is correct?","time":"80","type":"ABCD","answers":[{"right":false,"answer":"H0: μ=0.85 vs. H1: μ!=0.85","color":"#D6EDC9"},{"right":false,"answer":"H0: The model achieves consciousness.","color":"#B07156"},{"right":true,"answer":"H0: μ≤0.85 vs. H1: μ>0.85","color":"#7F7057"},{"right":false,"answer":"H0: μ>0.85 vs. H1: μ≤0.85","color":"#4E6E58"}],"image":"bae26cf3-9ce5-4436-974a-e874fc4bdfff","hide_results":false},{"question":"You are A/B testing a new “Buy” button color at significance level α = 0.05. You get resulting p-value 0.03. How will you decide?","time":"80","type":"ABCD","answers":[{"right":false,"answer":"Accept H0. The colors perform identically.","color":"#D6EDC9"},{"right":true,"answer":"Reject H0. The color change made a significant difference.","color":"#B07156"},{"right":false,"answer":"Fail to reject H0. The difference is just noise.","color":"#7F7057"},{"right":false,"answer":"No idea, just make the button invisible.","color":"#4E6E58"}],"image":"34102e84-278c-4b4b-87d4-6d06711f0e44","hide_results":false},{"question":"You are building a mission-critical AI for a nuclear reactor. You need to be extremely sure before you change any settings. Which α value do you choose?","time":"60","type":"ABCD","answers":[{"right":false,"answer":"α=1.00","color":"#D6EDC9"},{"right":false,"answer":"α=0.10","color":"#B07156"},{"right":false,"answer":"α=0.05","color":"#7F7057"},{"right":true,"answer":"α=0.01","color":"#4E6E58"}],"image":"f983ecd6-e6dc-447d-be70-b66c479c80e1","hide_results":false},{"question":"A firewall fails to identify a virus and lets it in. What type of error is this?","time":"60","type":"ABCD","answers":[{"right":false,"answer":"Type I","color":"#D6EDC9"},{"right":true,"answer":"Type II","color":"#B07156"}],"image":"34d3e951-c2dd-49ee-a9a5-dbdcfa09f97c","hide_results":false},{"question":"Which of the following are examples of a Type I Error?","time":"80","type":"CHECK","answers":[{"right":true,"answer":"Medical test saying you are sick when you are healthy.","color":"#D6EDC9"},{"right":false,"answer":"Spam filter marking a spam as real email.","color":"#B07156"},{"right":true,"answer":"FaceID unlocking your phone for a stranger.","color":"#7F7057"},{"right":false,"answer":"Your code running without errors on the first try.","color":"#4E6E58"}],"image":"03d27019-4bb6-45fd-9597-f8c5a71c97da","hide_results":false},{"question":"What does a p-value of 0.03 mean?","time":"60","type":"ABCD","answers":[{"right":false,"answer":"There are 3% of errors in the dataset.","color":"#D6EDC9"},{"right":false,"answer":"The model is 3% accurate.","color":"#B07156"},{"right":false,"answer":"The result is 97% correct.","color":"#7F7057"},{"right":true,"answer":"There is a 3% chance the result happened by random chance assuming the Null is true.","color":"#4E6E58"}],"image":"a9779386-606a-49ff-9626-936be203339d","hide_results":false},{"question":"You are building an AI for autonomous braking. H0: no obstacle. False Negative: car does not stop while seeing an obstacle. False positive: The car brakes for a shadow. How do you adjust α to make the car safer?","time":"80","type":"ABCD","answers":[{"right":true,"answer":"Increase α, Type I error increases, Type II error decreases","color":"#D6EDC9"},{"right":false,"answer":"Increase α, Type I error decreases, Type II error increases","color":"#B07156"},{"right":false,"answer":"Decrease α, Type I error decreases, Type II error increases","color":"#7F7057"},{"right":false,"answer":"Decrease α, Type I error increases, Type II error decreases","color":"#4E6E58"}],"image":"923adbe9-182a-4f66-a95f-f7f2783cd0e4","hide_results":false},{"question":"You get a p-value of 0.04. This means there is a 96% probability that the Alternative Hypothesis is true.","time":"40","type":"ABCD","answers":[{"right":false,"answer":"True","color":"#D6EDC9"},{"right":true,"answer":"False","color":"#B07156"}],"image":"25e74624-6e8e-46f3-a2af-fae5cd09cebb","hide_results":false},{"question":"Slide","time":"120","type":"SLIDE","answers":"{\"stage\":{\"attrs\":{\"width\":1520,\"height\":805,\"x\":0,\"y\":0},\"filters\":[],\"className\":\"Stage\"},\"layer\":{\"attrs\":{\"x\":0,\"y\":0,\"width\":1520,\"height\":805},\"filters\":[],\"className\":\"Layer\"},\"background\":{\"image\":{\"attrs\":{\"x\":0,\"y\":0},\"filters\":[],\"className\":\"Image\",\"zIndex\":0},\"overlay\":{\"attrs\":{\"className\":\"Rect\",\"x\":0,\"y\":0},\"filters\":[],\"className\":\"Rect\",\"zIndex\":1}},\"shapes\":[{\"attrs\":{\"x\":321,\"y\":271,\"width\":989.4,\"scaleY\":0.999999999999999,\"height\":122},\"filters\":[],\"className\":\"Label\",\"zIndex\":3,\"children\":[{\"attrs\":{\"width\":989.399993896487,\"height\":122,\"scaleX\":0.999999999999999},\"className\":\"Tag\"},{\"attrs\":{\"text\":\"Statistical tests\",\"fontSize\":\"122\",\"fill\":\"black\",\"height\":\"auto\",\"width\":989.399993896487,\"scaleX\":0.999999999999999},\"className\":\"Text\"}]}]}","image":null,"hide_results":false},{"question":"You trained a model to detect fake product reviews. You want to check if the categorical feature “Review Platform” (Amazon, eBay, Etsy) is independent of the model’s prediction (Fake, Genuine). Which statistical test do you use?","time":"70","type":"ABCD","answers":[{"right":false,"answer":"Z-test","color":"#D6EDC9"},{"right":false,"answer":"Pearson Correlation Coefficient ","color":"#B07156"},{"right":false,"answer":"Student’s T-test","color":"#7F7057"},{"right":true,"answer":"Chi-Square Test of Independence","color":"#4E6E58"}],"image":"a7ce808b-18ea-4391-9b6e-cc083d2a0d58","hide_results":false},{"question":"Comparing the average salary of Data Scientists vs. Software Engineers. You survey 100 random people from each job. Which test is appropriate?","time":"70","type":"ABCD","answers":[{"right":false,"answer":"Paired T-test","color":"#D6EDC9"},{"right":false,"answer":"One-Sample Z-test","color":"#B07156"},{"right":true,"answer":"Independent Two-Sample T-test","color":"#7F7057"},{"right":false,"answer":"A coding battle","color":"#4E6E58"}],"image":"25202e12-b7f8-4938-bfcf-ddef7c4e4fd9","hide_results":false},{"question":"You want to test if data augmentation improves model accuracy. You train a model on Dataset 1 (with aug) and Dataset 1 (without aug). You repeat this for all 20 datasets. Which test is appropriate?","time":"70","type":"ABCD","answers":[{"right":true,"answer":"Paired T-test","color":"#D6EDC9"},{"right":false,"answer":"The Turing Test","color":"#B07156"},{"right":false,"answer":"Independent Two-Sample T-test","color":"#7F7057"},{"right":false,"answer":"Chi-Square Test","color":"#4E6E58"}],"image":"4f8f1786-de05-4440-9ca2-446763efd519","hide_results":false},{"question":"When do you use a T-test instead of a Z-test?","time":"60","type":"ABCD","answers":[{"right":true,"answer":"When sample size is small.","color":"#D6EDC9"},{"right":false,"answer":"When sample size is huge.","color":"#B07156"},{"right":false,"answer":"When data is categorical.","color":"#7F7057"},{"right":false,"answer":"When you lost your Z-table.","color":"#4E6E58"}],"image":"1f7fdbdc-2564-4801-9ed3-23a1012a12ce","hide_results":false},{"question":"You test 1,000 random features against a target with α=0.05. How many features will likely appear significant purely by chance?","time":"40","type":"ABCD","answers":[{"right":false,"answer":"0","color":"#D6EDC9"},{"right":false,"answer":"5","color":"#B07156"},{"right":true,"answer":"50","color":"#7F7057"},{"right":false,"answer":"500","color":"#4E6E58"}],"image":"ccb10a04-24f4-433f-a4bf-799b1f70eca8","hide_results":false},{"question":"What is the Multiple Comparison Problem?","time":"80","type":"ABCD","answers":[{"right":false,"answer":"The statistical requirement to double your sample size for every new variable you add.","color":"#D6EDC9"},{"right":false,"answer":"When your dataset has too many duplicate rows.","color":"#B07156"},{"right":false,"answer":"When the features in your dataset are too similar to each other.","color":"#7F7057"},{"right":true,"answer":"Running many tests increases the chance of getting a \"significant\" result just by luck.","color":"#4E6E58"}],"image":"10736eb4-5721-476b-b77c-707affef3b66","hide_results":false},{"question":"You are doing a Grid Search with many tests. How do you fix the Multiple Comparison Problem?","time":"60","type":"ABCD","answers":[{"right":false,"answer":"Increase α to 0.5","color":"#D6EDC9"},{"right":true,"answer":"Use the Bonferroni Correction (lower the α)","color":"#B07156"},{"right":false,"answer":"Just ignore the p-values","color":"#7F7057"},{"right":false,"answer":"Use the Bonaparte Correction (increase the α)","color":"#4E6E58"}],"image":"bf5b937d-70b8-473a-b518-a5f7c5eb72c0","hide_results":false}],"imported_from_kahoot":false,"cover_image":null,"background_color":null,"background_image":null,"kahoot_id":null,"likes":0,"dislikes":0,"plays":8,"views":27,"mod_rating":null}]

@onderkova

Statistical Hypothesis Testing