{"id":295,"date":"2023-08-30T15:49:41","date_gmt":"2023-08-30T12:49:41","guid":{"rendered":"https:\/\/dsprog.pro\/?p=295"},"modified":"2023-09-10T07:51:27","modified_gmt":"2023-09-10T04:51:27","slug":"a-b-test-is-the-new-design-effective-for-the-site","status":"publish","type":"post","link":"https:\/\/dsprog.pro\/ru\/a-b-test-is-the-new-design-effective-for-the-site\/","title":{"rendered":"A-B \u0442\u0435\u0441\u0442. \u042f\u0432\u043b\u044f\u0435\u0442\u0441\u044f \u043b\u0438 \u043d\u043e\u0432\u044b\u0439 \u0434\u0438\u0437\u0430\u0439\u043d \u0431\u043e\u043b\u0435\u0435 \u044d\u0444\u0444\u0435\u043a\u0442\u0438\u0432\u043d\u044b\u043c \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u0430?"},"content":{"rendered":"\n<p>\u0410\u0432\u0442\u043e\u0440: \u0415\u0432\u0433\u0435\u043d\u0438\u0439 \u0411\u043e\u0434\u044f\u0433\u0438\u043d, https:\/\/dsprog.pro<\/p>\n\n\n\n<h1 class=\"wp-block-heading\" id=\"Introduction\">\u0412\u0432\u0435\u0434\u0435\u043d\u0438\u0435<\/h1>\n\n\n\n<p>\u041d\u0435\u043e\u0431\u0445\u043e\u0434\u0438\u043c\u043e \u043f\u0440\u043e\u0430\u043d\u0430\u043b\u0438\u0437\u0438\u0440\u043e\u0432\u0430\u0442\u044c \u044d\u0444\u0444\u0435\u043a\u0442\u0438\u0432\u043d\u043e\u0441\u0442\u044c \u043d\u043e\u0432\u043e\u0433\u043e \u0434\u0438\u0437\u0430\u0439\u043d\u0430 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u0430. \u0420\u0430\u0441\u043f\u043e\u043b\u0430\u0433\u0430\u0435\u043c \u0434\u0430\u043d\u043d\u044b\u043c\u0438 \u043e \u043f\u043e\u043b\u044c\u0437\u043e\u0432\u0430\u0442\u0435\u043b\u044f\u0445 \u0441\u0430\u0439\u0442\u0430 \u0441\u043e \u0437\u043d\u0430\u0447\u0435\u043d\u0438\u0435\u043c \u043a\u043e\u043d\u0432\u0435\u0440\u0441\u0438\u0438 \u043f\u043e \u043a\u0430\u0436\u0434\u043e\u043c\u0443 \u043f\u043e\u043b\u044c\u0437\u043e\u0432\u0430\u0442\u0435\u043b\u044e\/\u0441\u0435\u0430\u043d\u0441\u0443. \u041f\u0440\u043e\u0432\u0435\u0434\u0435\u043c A-B \u0442\u0435\u0441\u0442. \u041f\u0440\u0435\u0436\u043d\u044e\u044e \u0444\u043e\u0440\u043c\u0443 \u0434\u0438\u0437\u0430\u0439\u043d\u0430 \u043d\u0430\u0437\u043e\u0432\u0435\u043c &#171;\u0410&#187;; \u043d\u043e\u0432\u0443\u044e \u0444\u043e\u0440\u043c\u0443 \u0434\u0438\u0437\u0430\u0439\u043d\u0430 \u043d\u0430\u0437\u043e\u0432\u0435\u043c &#171;B&#187;.<\/p>\n\n\n\n<h1 class=\"wp-block-heading\" id=\"\u0414\u0438\u0437\u0430\u0439\u043d-\u044d\u043a\u0441\u043f\u0435\u0440\u0438\u043c\u0435\u043d\u0442\u0430\">\u0414\u0438\u0437\u0430\u0439\u043d \u044d\u043a\u0441\u043f\u0435\u0440\u0438\u043c\u0435\u043d\u0442\u0430<a href=\"http:\/\/localhost:8888\/notebooks\/Users\/targetplanet\/Desktop\/dsprog\/dsprog__efphagp3bf\/a-b-testing__ru__efphagp3bf.ipynb#\u0414\u0438\u0437\u0430\u0439\u043d-\u044d\u043a\u0441\u043f\u0435\u0440\u0438\u043c\u0435\u043d\u0442\u0430\"><\/a><\/h1>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>\u041d\u0443\u043b\u0435\u0432\u0430\u044f \u0433\u0438\u043f\u043e\u0442\u0435\u0437\u0430<\/strong>: \u041d\u0435\u0442 \u0440\u0430\u0437\u043d\u0438\u0446\u044b \u0432 \u044d\u0444\u0444\u0435\u043a\u0442\u0438\u0432\u043d\u043e\u0441\u0442\u0438 \u043c\u0435\u0436\u0434\u0443 \u0434\u0438\u0437\u0430\u0439\u043d\u043e\u043c A \u0438 B.<\/li>\n\n\n\n<li><strong>\u0410\u043b\u044c\u0442\u0435\u0440\u043d\u0430\u0442\u0438\u0432\u043d\u0430\u044f \u0433\u0438\u043f\u043e\u0442\u0435\u0437\u0430<\/strong>: \u0415\u0441\u0442\u044c \u0437\u043d\u0430\u0447\u0438\u0442\u0435\u043b\u044c\u043d\u0430\u044f \u0440\u0430\u0437\u043d\u0438\u0446\u0430 \u0432 \u044d\u0444\u0444\u0435\u043a\u0442\u0438\u0432\u043d\u043e\u0441\u0442\u0438 \u043c\u0435\u0436\u0434\u0443 \u0434\u0438\u0437\u0430\u0439\u043d\u043e\u043c A \u0438 B.<\/li>\n\n\n\n<li><strong>\u041e\u0431\u044a\u0435\u043a\u0442 \u043e\u0431\u0440\u0430\u0431\u043e\u0442\u043a\u0438<\/strong>: \u0414\u0432\u0435 \u0432\u044b\u0431\u043e\u0440\u043a\u0438 \u0441\u0435\u0430\u043d\u0441\u043e\u0432 \u043f\u043e\u0441\u0435\u0442\u0438\u0442\u0435\u043b\u0435\u0439 \u0441\u0430\u0439\u0442\u0430 \u043f\u0435\u0440\u0435\u043c\u0435\u0448\u0430\u043d\u043d\u044b\u0435 \u0441\u043b\u0443\u0447\u0430\u0439\u043d\u044b\u043c \u043e\u0431\u0440\u0430\u0437\u043e\u043c. \u0420\u0430\u0437\u043c\u0435\u0440 \u0432\u044b\u0431\u043e\u0440\u043e\u043a \u043e\u0434\u0438\u043d\u0430\u043a\u043e\u0432.<\/li>\n\n\n\n<li><strong>\u0426\u0435\u043b\u0435\u0432\u0430\u044f \u0430\u0443\u0434\u0438\u0442\u043e\u0440\u0438\u044f<\/strong>: \u041f\u043e\u0441\u0435\u0442\u0438\u0442\u0435\u043b\u0438 \u0441\u0430\u0439\u0442\u0430 \u0437\u0430 \u043f\u043e\u0441\u043b\u0435\u0434\u043d\u0438\u0435 40 \u0434\u043d\u0435\u0439.<\/li>\n\n\n\n<li><strong>\u041c\u0435\u0442\u0440\u0438\u043a\u0438<\/strong>: Impressions, Clicks, Purchase, Earning<\/li>\n\n\n\n<li><strong>\u0414\u043b\u0438\u0442\u0435\u043b\u044c\u043d\u043e\u0441\u0442\u044c \u043f\u0440\u043e\u0432\u0435\u0434\u0435\u043d\u0438\u044f \u0442\u0435\u0441\u0442\u0430<\/strong>: 40 \u0434\u043d\u0435\u0439.<\/li>\n\n\n\n<li><strong>\u0423\u0440\u043e\u0432\u043d\u0438 \u0437\u043d\u0430\u0447\u0438\u043c\u043e\u0441\u0442\u0438<\/strong>:<\/li>\n\n\n\n<li><strong>\u03b1<\/strong> = 0.05<\/li>\n\n\n\n<li><strong>\u03b2<\/strong> = 0.2<\/li>\n\n\n\n<li>\u041a\u0430\u043c\u043f\u0430\u043d\u0438\u0438 \u0437\u0430\u043f\u0443\u0441\u043a\u0430\u044e\u0442\u0441\u044f \u043e\u0434\u043d\u043e\u0432\u0440\u0435\u043c\u0435\u043d\u043d\u043e, \u0430 \u0430\u0443\u0434\u0438\u0442\u043e\u0440\u0438\u044f \u0434\u0435\u043b\u0438\u0442\u0441\u044f \u0441\u043b\u0443\u0447\u0430\u0439\u043d\u044b\u043c \u043e\u0431\u0440\u0430\u0437\u043e\u043c.<\/li>\n<\/ul>\n\n\n\n<h1 class=\"wp-block-heading\" id=\"Data-structure\">\u0421\u0442\u0440\u0443\u043a\u0442\u0443\u0440\u0430 \u0434\u0430\u043d\u043d\u044b\u0445<\/h1>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>\u041d\u0430\u0437\u0432\u0430\u043d\u0438\u0435 \u043a\u0430\u043c\u043f\u0430\u043d\u0438\u0438 (Campaign Name):<\/strong> \u041d\u0430\u0437\u0432\u0430\u043d\u0438\u0435 \u043a\u0430\u043c\u043f\u0430\u043d\u0438\u0438.<\/li>\n\n\n\n<li><strong>\u041f\u043e\u043a\u0430\u0437\u044b (Impression):<\/strong> \u041a\u043e\u043b\u0438\u0447\u0435\u0441\u0442\u0432\u043e \u043f\u043e\u043a\u0430\u0437\u043e\u0432 \u0440\u0435\u043a\u043b\u0430\u043c\u044b.<\/li>\n\n\n\n<li><strong>\u041a\u043b\u0438\u043a\u0438 (Click):<\/strong> \u041a\u043e\u043b\u0438\u0447\u0435\u0441\u0442\u0432\u043e \u043a\u043b\u0438\u043a\u043e\u0432 \u043d\u0430 \u0431\u0430\u043d\u043d\u0435\u0440 \u0438 \u043f\u0435\u0440\u0435\u0448\u043b\u0438 \u043d\u0430 \u0441\u0430\u0439\u0442.<\/li>\n\n\n\n<li><strong>\u041f\u043e\u043a\u0443\u043f\u043a\u0438 (Purchase):<\/strong> \u0421\u043a\u043e\u043b\u044c\u043a\u043e \u0440\u0430\u0437 \u043f\u043e\u043b\u044c\u0437\u043e\u0432\u0430\u0442\u0435\u043b\u0438 \u0441\u043e\u0432\u0435\u0440\u0448\u0438\u043b\u0438 \u043f\u043e\u043a\u0443\u043f\u043a\u0443.<\/li>\n\n\n\n<li><strong>\u041f\u0440\u0438\u0431\u044b\u043b\u044c (Earning):<\/strong> \u041f\u0440\u0438\u0431\u044b\u043b\u044c \u043f\u043e\u0441\u043b\u0435 \u043f\u043e\u043a\u0443\u043f\u043a\u0438 \u0442\u043e\u0432\u0430\u0440\u043e\u0432.<\/li>\n<\/ul>\n\n\n\n<pre class=\"EnlighterJSRAW\" data-enlighter-language=\"python\" data-enlighter-theme=\"dracula\" data-enlighter-highlight=\"\" data-enlighter-linenumbers=\"\" data-enlighter-lineoffset=\"\" data-enlighter-title=\"\" data-enlighter-group=\"\">import itertools\nimport numpy as np\nimport pandas as pd\nimport matplotlib.pyplot as plt\nimport seaborn as sns\nimport statsmodels.stats.api as sms\nfrom scipy.stats import ttest_1samp, shapiro, levene, ttest_ind, mannwhitneyu, pearsonr, spearmanr, kendalltau, \n    f_oneway, kruskal\n# this content is from dsprog.pro\nfrom statsmodels.stats.proportion import proportions_ztest\n\npd.set_option('display.max_columns', None)\npd.set_option('display.max_rows', 10)\npd.set_option('display.float_format', lambda x: '%.5f' % x)<\/pre>\n\n\n\n<h2 class=\"wp-block-heading\">\u041e\u043f\u0440\u0435\u0434\u0435\u043b\u0435\u043d\u0438\u0435 \u0443\u0440\u043e\u0432\u043d\u0435\u0439: \u0437\u043d\u0430\u0447\u0438\u043c\u043e\u0441\u0442\u044c \u0442\u0435\u0441\u0442\u0430 \u0438 \u043c\u043e\u0449\u043d\u043e\u0441\u0442\u044c \u0442\u0435\u0441\u0442\u0430<\/h2>\n\n\n\n<pre class=\"EnlighterJSRAW\" data-enlighter-language=\"python\" data-enlighter-theme=\"dracula\" data-enlighter-highlight=\"\" data-enlighter-linenumbers=\"\" data-enlighter-lineoffset=\"\" data-enlighter-title=\"\" data-enlighter-group=\"\">import scipy\n# Significance level (Probability of Type I error) that is used to decide whether to reject the null hypothesis.\nalpha = 0.05 \n# Power of the test (probability of type II error), which indicates the probability of not detecting a real effect when it exists.\nbeta = 0.2 <\/pre>\n\n\n\n<h2 class=\"wp-block-heading\">\u0417\u0430\u0433\u0440\u0443\u0437\u043a\u0430 \u0434\u0430\u043d\u043d\u044b\u0445<\/h2>\n\n\n\n<p>\u042d\u043a\u0441\u043f\u0435\u0440\u0438\u043c\u0435\u043d\u0442 \u043f\u0440\u043e\u0432\u043e\u0434\u0438\u043b\u0441\u044f \u0432 \u0442\u0435\u0447\u0435\u043d\u0438\u0435 40 \u0434\u043d\u0435\u0439. \u0417\u0430\u0433\u0440\u0443\u0437\u0438\u043c \u0438\u043c\u0435\u044e\u0449\u0438\u0435\u0441\u044f \u0434\u0430\u043d\u043d\u044b\u0435.<\/p>\n\n\n\n<pre class=\"EnlighterJSRAW\" data-enlighter-language=\"python\" data-enlighter-theme=\"dracula\" data-enlighter-highlight=\"\" data-enlighter-linenumbers=\"\" data-enlighter-lineoffset=\"\" data-enlighter-title=\"\" data-enlighter-group=\"\">a_group = pd.read_csv('input\/Xa_group.csv', delimiter=',')\na_group.head()<\/pre>\n\n\n\n<figure class=\"wp-block-table\"><table><thead><tr><th><\/th><th>Campaign Name<\/th><th>Impression<\/th><th>Click<\/th><th>Purchase<\/th><th>Earning<\/th><\/tr><\/thead><tbody><tr><th>0<\/th><td>a campaign<\/td><td>77198<\/td><td>4774<\/td><td>307<\/td><td>1933<\/td><\/tr><tr><th>1<\/th><td>a campaign<\/td><td>126169<\/td><td>4285<\/td><td>574<\/td><td>2572<\/td><\/tr><tr><th>2<\/th><td>a campaign<\/td><td>114917<\/td><td>4134<\/td><td>720<\/td><td>2212<\/td><\/tr><tr><th>3<\/th><td>a campaign<\/td><td>133553<\/td><td>5144<\/td><td>545<\/td><td>1957<\/td><\/tr><tr><th>4<\/th><td>a campaign<\/td><td>90761<\/td><td>1948<\/td><td>186<\/td><td>1675<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<pre class=\"EnlighterJSRAW\" data-enlighter-language=\"python\" data-enlighter-theme=\"dracula\" data-enlighter-highlight=\"\" data-enlighter-linenumbers=\"\" data-enlighter-lineoffset=\"\" data-enlighter-title=\"\" data-enlighter-group=\"\">b_group = pd.read_csv('input\/Xb_group.csv', delimiter=',')\nb_group.head()<\/pre>\n\n\n\n<figure class=\"wp-block-table\"><table><thead><tr><th><\/th><th>Campaign Name<\/th><th>Impression<\/th><th>Click<\/th><th>Purchase<\/th><th>Earning<\/th><\/tr><\/thead><tbody><tr><th>0<\/th><td>b campaign<\/td><td>115507<\/td><td>1942<\/td><td>656<\/td><td>2335<\/td><\/tr><tr><th>1<\/th><td>b campaign<\/td><td>130944<\/td><td>2844<\/td><td>606<\/td><td>2748<\/td><\/tr><tr><th>2<\/th><td>b campaign<\/td><td>175336<\/td><td>2953<\/td><td>287<\/td><td>3690<\/td><\/tr><tr><th>3<\/th><td>b campaign<\/td><td>139732<\/td><td>3550<\/td><td>709<\/td><td>2184<\/td><\/tr><tr><th>4<\/th><td>b campaign<\/td><td>108745<\/td><td>3261<\/td><td>297<\/td><td>2454<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<pre class=\"EnlighterJSRAW\" data-enlighter-language=\"python\" data-enlighter-theme=\"dracula\" data-enlighter-highlight=\"\" data-enlighter-linenumbers=\"\" data-enlighter-lineoffset=\"\" data-enlighter-title=\"\" data-enlighter-group=\"\">desired_palette = [\"#0099cc\", \"#009900\"]\ndata_all = pd.concat([a_group, b_group])\nfig, ax = plt.subplots(ncols=4, figsize=(26,5))\nax1 = sns.barplot(data=data_all, x='Campaign Name', y='Impression', errorbar=('ci', False), ax=ax[0], estimator='sum', palette=desired_palette)\nax2 = sns.barplot(data=data_all, x='Campaign Name', y='Click', errorbar=('ci', False), ax=ax[1], estimator='sum', palette=desired_palette)\nax4 = sns.barplot(data=data_all, x='Campaign Name', y='Purchase', errorbar=('ci', False), ax=ax[2], estimator='sum', palette=desired_palette)\nax5 = sns.barplot(data=data_all, x='Campaign Name', y='Earning', errorbar=('ci', False), ax=ax[3], estimator='sum', palette=desired_palette)\n# this content is from dsprog.pro\nax1.set_title('Impression')\nax2.set_title('Click')\nax4.set_title('Purchase')\nax5.set_title('Earning')\n\nplt.show()<\/pre>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"2073\" height=\"470\" src=\"https:\/\/dsprog.pro\/wp-content\/uploads\/2023\/08\/efphagp3bf_0.png\" alt=\"\" class=\"wp-image-269\"\/><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\">\u0414\u043e\u0440\u043e\u0436\u043d\u0430\u044f \u043a\u0430\u0440\u0442\u0430 \u0444\u043e\u0440\u043c\u0443\u043b\u0438\u0440\u043e\u0432\u043a\u0438 \u0433\u0438\u043f\u043e\u0442\u0435\u0437<\/h2>\n\n\n\n<ol class=\"wp-block-list\">\n<li>\u041f\u0440\u0435\u0434\u043f\u043e\u043b\u043e\u0436\u0435\u043d\u0438\u0435 \u0442\u043e\u0433\u043e, \u0447\u0442\u043e \u0434\u0430\u043d\u043d\u044b\u0435 \u0440\u0430\u0441\u043f\u0440\u0435\u0434\u0435\u043b\u0435\u043d\u044b \u043d\u043e\u0440\u043c\u0430\u043b\u044c\u043d\u043e (\u043d\u043e\u0440\u043c\u0430\u043b\u044c\u043d\u043e\u0441\u0442\u044c)<\/li>\n\n\n\n<li>\u041f\u0440\u0435\u0434\u043f\u043e\u043b\u043e\u0436\u0435\u043d\u0438\u0435 \u0442\u043e\u0433\u043e, \u0447\u0442\u043e \u0434\u0438\u0441\u043f\u0435\u0440\u0441\u0438\u044f \u043e\u0434\u043d\u043e\u0440\u043e\u0434\u043d\u0430 (\u0433\u043e\u043c\u043e\u0433\u0435\u043d\u043d\u043e\u0441\u0442\u044c).<\/li>\n<\/ol>\n\n\n\n<p>\u041e\u0431\u0430 \u043f\u0440\u0435\u0434\u043f\u043e\u043b\u043e\u0436\u0435\u043d\u0438\u044f \u0431\u0443\u0434\u0443\u0442 \u043f\u0440\u043e\u0432\u0435\u0440\u0435\u043d\u044b \u043f\u043e\u0441\u0440\u0435\u0434\u0441\u0442\u0432\u043e\u043c \u043a\u0440\u0438\u0442\u0435\u0440\u0438\u044f \u0441\u0442\u0430\u0442\u0438\u0441\u0442\u0438\u0447\u0435\u0441\u043a\u043e\u0439 \u0437\u043d\u0430\u0447\u0438\u043c\u043e\u0441\u0442\u0438. \u0412\u0438\u0434 \u0442\u0435\u0441\u0442\u043e\u0432, \u0431\u0443\u0434\u0435\u0442 \u0432\u044b\u0431\u0440\u0430\u043d \u0434\u043b\u044f \u043a\u0430\u0436\u0434\u043e\u0439 \u0437\u0430\u0434\u0430\u0447\u0438. \u0415\u0441\u043b\u0438 \u043e\u0431\u0430 \u043f\u0440\u0435\u0434\u043f\u043e\u043b\u043e\u0436\u0435\u043d\u0438\u044f \u0434\u043e\u043f\u0443\u0441\u0442\u0438\u043c\u044b, \u043f\u0440\u0438\u043c\u0435\u043d\u0438\u043c \u0434\u0432\u0430 \u043d\u0435\u0437\u0430\u0432\u0438\u0441\u0438\u043c\u044b\u0445 \u0432\u044b\u0431\u043e\u0440\u043e\u0447\u043d\u044b\u0445 t-\u0442\u0435\u0441\u0442\u0430. \u0415\u0441\u043b\u0438 \u043e\u0434\u043d\u043e \u0438\u0437 \u043f\u0440\u0435\u0434\u043f\u043e\u043b\u043e\u0436\u0435\u043d\u0438\u0439 \u043c\u043e\u0436\u043d\u043e \u043e\u0442\u043a\u043b\u043e\u043d\u0438\u0442\u044c, \u0431\u0443\u0434\u0435\u0442 \u043f\u0440\u0438\u043c\u0435\u043d\u0435\u043d \u043a\u0440\u0438\u0442\u0435\u0440\u0438\u0439 U-\u043a\u0440\u0438\u0442\u0435\u0440\u0438\u0439 \u041c\u0430\u043d\u043d\u0430 \u2014 \u0423\u0438\u0442\u043d\u0438 (\u043d\u0435\u043f\u0430\u0440\u0430\u043c\u0435\u0442\u0440\u0438\u0447\u0435\u0441\u043a\u0438\u0439 \u043a\u0440\u0438\u0442\u0435\u0440\u0438\u0439).<\/p>\n\n\n\n<p>\u0417\u0430\u043c\u0435\u0447\u0430\u043d\u0438\u0435: t-\u043a\u0440\u0438\u0442\u0435\u0440\u0438\u0439 \u0438\u0441\u043f\u043e\u043b\u044c\u0437\u0443\u0435\u0442\u0441\u044f \u0434\u043b\u044f \u043f\u0440\u043e\u0432\u0435\u0440\u043a\u0438 \u0441\u0443\u0449\u0435\u0441\u0442\u0432\u043e\u0432\u0430\u043d\u0438\u044f \u0441\u0442\u0430\u0442\u0438\u0441\u0442\u0438\u0447\u0435\u0441\u043a\u0438 \u0437\u043d\u0430\u0447\u0438\u043c\u043e\u0439 \u0440\u0430\u0437\u043d\u0438\u0446\u044b \u043c\u0435\u0436\u0434\u0443 \u0434\u0432\u0443\u043c\u044f \u0433\u0440\u0443\u043f\u043f\u043e\u0439 A \u0438 \u0433\u0440\u0443\u043f\u043f\u043e\u0439 B \u043f\u0443\u0442\u0435\u043c \u0440\u0430\u0441\u0441\u043c\u043e\u0442\u0440\u0435\u043d\u0438\u044f \u0441\u0440\u0435\u0434\u043d\u0438\u0445 \u0437\u043d\u0430\u0447\u0435\u043d\u0438\u0439. \u042d\u0442\u043e \u043f\u0430\u0440\u0430\u043c\u0435\u0442\u0440\u0438\u0447\u0435\u0441\u043a\u0438\u0439 \u0442\u0435\u0441\u0442.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">\u0422\u0435\u0441\u0442 \u0428\u0430\u043f\u0438\u0440\u043e-\u0423\u0438\u043b\u043a\u0430<\/h2>\n\n\n\n<p>\u0421\u0443\u0449\u0435\u0441\u0442\u0432\u0443\u0435\u0442 \u0431\u043e\u043b\u044c\u0448\u043e\u0435 \u043a\u043e\u043b\u0438\u0447\u0435\u0441\u0442\u0432\u043e \u0442\u0435\u0441\u0442\u043e\u0432 \u043d\u0430 \u043d\u043e\u0440\u043c\u0430\u043b\u044c\u043d\u043e\u0441\u0442\u044c. \u041d\u0430\u0438\u0431\u043e\u043b\u0435\u0435 \u0438\u0437\u0432\u0435\u0441\u0442\u043d\u044b\u043c\u0438 \u0438\u0437 \u043d\u0438\u0445 \u044f\u0432\u043b\u044f\u044e\u0442\u0441\u044f \u043a\u0440\u0438\u0442\u0435\u0440\u0438\u0439:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>\u043a\u0440\u0438\u0442\u0435\u0440\u0438\u0439 \u0445\u0438-\u043a\u0432\u0430\u0434\u0440\u0430\u0442;<\/li>\n\n\n\n<li>\u043a\u0440\u0438\u0442\u0435\u0440\u0438\u0439 \u041a\u043e\u043b\u043c\u043e\u0433\u043e\u0440\u043e\u0432\u0430-\u0421\u043c\u0438\u0440\u043d\u043e\u0432\u0430;<\/li>\n\n\n\n<li>\u043a\u0440\u0438\u0442\u0435\u0440\u0438\u0439 \u041b\u0438\u043b\u043b\u0438\u0435\u0444\u043e\u0440\u0441\u0430;<\/li>\n\n\n\n<li>\u043a\u0440\u0438\u0442\u0435\u0440\u0438\u0439 \u043d\u043e\u0440\u043c\u0430\u043b\u044c\u043d\u043e\u0441\u0442\u0438 \u0428\u0430\u043f\u0438\u0440\u043e-\u0423\u0438\u043b\u043a\u0430. \u0418\u0441\u043f\u043e\u043b\u044c\u0437\u0443\u0435\u043c \u043f\u043e\u0441\u043b\u0435\u0434\u043d\u0438\u0439 \u0438\u0437 \u043d\u0438\u0445.<\/li>\n<\/ul>\n\n\n\n<p>Unable to reject Null Hypothesis for &#171;Impression&#187; in &#171;group A&#187;, because &#171;Test Stat group A&#187; = 0.9810 and &#171;p-value_a&#187; = 0.7250 Unable to reject Null Hypothesis for &#171;Impression&#187; in &#171;group B&#187;, because &#171;Test Stat group B&#187; = 0.9609 and &#171;p-value_b&#187; = 0.1801<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"1156\" height=\"547\" src=\"https:\/\/dsprog.pro\/wp-content\/uploads\/2023\/08\/efphagp3bf_1.png\" alt=\"\" class=\"wp-image-277\"\/><\/figure>\n\n\n\n<p>Unable to reject Null Hypothesis for &#171;Click&#187; in &#171;group A&#187;, because &#171;Test Stat group A&#187; = 0.9882 and &#171;p-value_a&#187; = 0.9465 Unable to reject Null Hypothesis for &#171;Click&#187; in &#171;group B&#187;, because &#171;Test Stat group B&#187; = 0.9709 and &#171;p-value_b&#187; = 0.3851<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"1191\" height=\"547\" src=\"https:\/\/dsprog.pro\/wp-content\/uploads\/2023\/08\/efphagp3bf_2.png\" alt=\"\" class=\"wp-image-278\"\/><\/figure>\n\n\n\n<p>Unable to reject Null Hypothesis for &#171;Purchase&#187; in &#171;group A&#187;, because &#171;Test Stat group A&#187; = 0.9775 and &#171;p-value_a&#187; = 0.5972<br>Unable to reject Null Hypothesis for &#171;Purchase&#187; in &#171;group B&#187;, because &#171;Test Stat group B&#187; = 0.9690 and &#171;p-value_b&#187; = 0.3341<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"1182\" height=\"547\" src=\"https:\/\/dsprog.pro\/wp-content\/uploads\/2023\/08\/efphagp3bf_3.png\" alt=\"\" class=\"wp-image-279\"\/><\/figure>\n\n\n\n<p>Unable to reject Null Hypothesis for &#171;Earning&#187; in &#171;group A&#187;, because &#171;Test Stat group A&#187; = 0.9790 and &#171;p-value_a&#187; = 0.6524 Unable to reject Null Hypothesis for &#171;Earning&#187; in &#171;group B&#187;, because &#171;Test Stat group B&#187; = 0.9734 and &#171;p-value_b&#187; = 0.4570 <\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"1182\" height=\"547\" src=\"https:\/\/dsprog.pro\/wp-content\/uploads\/2023\/08\/efphagp3bf_4.png\" alt=\"\" class=\"wp-image-281\"\/><\/figure>\n\n\n\n<p>\u0418\u0442\u0430\u043a. \u041d\u0438 \u043f\u043e \u043e\u0434\u043d\u043e\u043c\u0443 \u0438\u0437 \u043f\u043e\u043a\u0430\u0437\u0430\u0442\u0435\u043b\u0435\u0439: Impression, Click, Purchase \u043d\u0435\u043b\u044c\u0437\u044f \u043e\u0442\u0432\u0435\u0440\u0433\u043d\u0443\u0442\u044c \u043d\u0443\u043b\u0435\u0432\u0443\u044e \u0433\u0438\u043f\u043e\u0442\u0435\u0437\u0443 \u043e \u043d\u043e\u0440\u043c\u0430\u043b\u044c\u043d\u043e\u0441\u0442\u0438 \u0440\u0430\u0441\u043f\u0440\u0435\u0434\u0435\u043b\u0435\u043d\u0438\u044f.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">\u0422\u0435\u0441\u0442 \u041b\u0435\u0432\u0435\u043d\u0430<\/h2>\n\n\n\n<p>\u041f\u0440\u043e\u0432\u043e\u0434\u0438\u043c \u0442\u0435\u0441\u0442 \u041b\u0435\u0432\u0435\u043d\u0430, \u0447\u0442\u043e\u0431\u044b \u043f\u0440\u043e\u0432\u0435\u0440\u0438\u0442\u044c, \u0435\u0441\u0442\u044c \u043b\u0438 \u0437\u043d\u0430\u0447\u0438\u043c\u044b\u0435 \u0440\u0430\u0437\u043b\u0438\u0447\u0438\u044f \u0432 \u0432\u0430\u0440\u0438\u0430\u0446\u0438\u044f\u0445 \u043c\u0435\u0436\u0434\u0443 \u0433\u0440\u0443\u043f\u043f\u0430\u043c\u0438.<\/p>\n\n\n\n<pre class=\"EnlighterJSRAW\" data-enlighter-language=\"python\" data-enlighter-theme=\"dracula\" data-enlighter-highlight=\"\" data-enlighter-linenumbers=\"\" data-enlighter-lineoffset=\"\" data-enlighter-title=\"\" data-enlighter-group=\"\">columns = [\"Impression\", \"Click\", \"Purchase\", \"Earning\"]\nfor column in columns:\n    test_stat, pvalue = levene(a_group[column], b_group[column])\n    if (pvalue &lt; alpha):\n        print('Reject Null Hypothesis for \"%s\" because \"Test Stat\" = %.4f and \"p-value\" = %.4f ' % (column, test_stat, pvalue))\n    else:\n        print('Unable to reject Null Hypothesis for for \"%s\" because \"Test Stat\" = %.4f and \"p-value\" = %.4f ' % (column, test_stat, pvalue))\n  <\/pre>\n\n\n\n<p>Unable to reject Null Hypothesis for for &#171;Impression&#187; because &#171;Test Stat&#187; = 0.5893 and &#171;p-value&#187; = 0.4450 <br>Unable to reject Null Hypothesis for for &#171;Click&#187; because &#171;Test Stat&#187; = 0.0978 and &#171;p-value&#187; = 0.7553 <br>Unable to reject Null Hypothesis for for &#171;Purchase&#187; because &#171;Test Stat&#187; = 0.0232 and &#171;p-value&#187; = 0.8793 <br>Unable to reject Null Hypothesis for for &#171;Earning&#187; because &#171;Test Stat&#187; = 0.2993 and &#171;p-value&#187; = 0.5859<\/p>\n\n\n\n<p>\u0418\u0442\u0430\u043a. \u041d\u0438 \u043f\u043e \u043e\u0434\u043d\u043e\u043c\u0443 \u0438\u0437 \u043f\u043e\u043a\u0430\u0437\u0430\u0442\u0435\u043b\u0435\u0439: Impression, Click, Purchase \u043d\u0435\u043b\u044c\u0437\u044f \u043e\u0442\u0432\u0435\u0440\u0433\u043d\u0443\u0442\u044c \u043d\u0443\u043b\u0435\u0432\u0443\u044e \u0433\u0438\u043f\u043e\u0442\u0435\u0437\u0443 \u043e\u0431 \u043e\u0442\u0441\u0443\u0442\u0441\u0442\u0432\u0438\u0438 \u0437\u043d\u0430\u0447\u0438\u043c\u044b\u0445 \u0440\u0430\u0437\u043b\u0438\u0447\u0438\u0439 \u0432 \u0432\u0430\u0440\u0438\u0430\u0446\u0438\u044f\u0445 \u043c\u0435\u0436\u0434\u0443 \u0433\u0440\u0443\u043f\u043f\u0430\u043c\u0438.<\/p>\n\n\n\n<p>\u0412 \u0441\u043e\u043e\u0442\u0432\u0435\u0442\u0441\u0442\u0432\u0438\u0435 \u0441 \u043e\u043f\u0440\u0435\u0434\u0435\u043b\u0435\u043d\u043d\u043e\u0439 \u0432\u044b\u0448\u0435 \u0434\u043e\u0440\u043e\u0436\u043d\u043e\u0439 \u043a\u0430\u0440\u0442\u043e\u0439 \u0444\u043e\u0440\u043c\u0443\u043b\u0438\u0440\u043e\u0432\u043a\u0438 \u0433\u0438\u043f\u043e\u0442\u0435\u0437 \u044d\u0442\u043e \u043e\u0437\u043d\u0430\u0447\u0430\u0435\u0442, \u0447\u0442\u043e \u043c\u043e\u0436\u0435\u043c \u043f\u0440\u0438\u043c\u0435\u043d\u0438\u0442\u044c \u0434\u0432\u0430 \u043d\u0435\u0437\u0430\u0432\u0438\u0441\u0438\u043c\u044b\u0445 \u0432\u044b\u0431\u043e\u0440\u043e\u0447\u043d\u044b\u0445 T-\u0442\u0435\u0441\u0442\u0430.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">T \u0442\u0435\u0441\u0442<\/h2>\n\n\n\n<pre class=\"EnlighterJSRAW\" data-enlighter-language=\"python\" data-enlighter-theme=\"dracula\" data-enlighter-highlight=\"\" data-enlighter-linenumbers=\"\" data-enlighter-lineoffset=\"\" data-enlighter-title=\"\" data-enlighter-group=\"\">columns = [\"Impression\", \"Click\", \"Purchase\", \"Earning\"]\nfor column in columns:\n    test_stat, pvalue = ttest_ind(a_group[column], b_group[column], equal_var=True)\n    if (pvalue &lt; alpha):\n        # this content is from dsprog.pro\n        print('Reject Null Hypothesis for \"%s\" because \"Test Stat\" = %.4f and \"p-value\" = %.4f ' % (column, test_stat, pvalue))\n    else:\n        print('Unable to reject Null Hypothesis for for \"%s\" because \"Test Stat\" = %.4f and \"p-value\" = %.4f ' % (column, test_stat, pvalue))\n <\/pre>\n\n\n\n<p>Reject Null Hypothesis for &#171;Impression&#187; because &#171;Test Stat&#187; = -4.1173 and &#171;p-value&#187; = 0.0001 <br>Reject Null Hypothesis for &#171;Click&#187; because &#171;Test Stat&#187; = 2.7901 and &#171;p-value&#187; = 0.0066 <br>Unable to reject Null Hypothesis for for &#171;Purchase&#187; because &#171;Test Stat&#187; = -1.2474 and &#171;p-value&#187; = 0.2160 <br>Reject Null Hypothesis for &#171;Earning&#187; because &#171;Test Stat&#187; = -7.0324 and &#171;p-value&#187; = 0.0000<\/p>\n\n\n\n<p>\u0418\u0442\u0430\u043a, \u0441 \u043f\u043e\u043c\u043e\u0449\u044c\u044e t-\u043a\u0440\u0438\u0442\u0435\u0440\u0438\u044f \u043e\u043f\u0440\u0435\u0434\u0435\u043b\u0438\u043b\u0438 \u0435\u0434\u0438\u043d\u0441\u0442\u0432\u0435\u043d\u043d\u044b\u0439 \u043f\u0430\u0440\u0430\u043c\u0435\u0442\u0440 (Purchase), \u043a\u043e\u0442\u043e\u0440\u044b\u0439 \u043d\u0435 \u0438\u043c\u0435\u0435\u0442 \u0441\u0442\u0430\u0442\u0438\u0441\u0442\u0438\u0447\u0435\u0441\u043a\u0438 \u0437\u043d\u0430\u0447\u0438\u043c\u0443\u044e \u0440\u0430\u0437\u043d\u0438\u0446\u0443 \u043c\u0435\u0436\u0434\u0443 \u0433\u0440\u0443\u043f\u043f\u043e\u0439 A \u0438 \u0433\u0440\u0443\u043f\u043f\u043e\u0439 B. \u041f\u043e \u043e\u0441\u0442\u0430\u043b\u044c\u043d\u044b\u043c \u043f\u0430\u0440\u0430\u043c\u0435\u0442\u0440\u0430\u043c \u0432\u043e\u0437\u043c\u043e\u0436\u043d\u043e \u043e\u0442\u043a\u043b\u043e\u043d\u0438\u0442\u044c \u043d\u0443\u043b\u0435\u0432\u0443\u044e \u0433\u0438\u043f\u043e\u0442\u0435\u0437\u0443.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">\u041f\u0440\u043e\u043c\u0435\u0436\u0443\u0442\u043e\u0447\u043d\u044b\u0439 \u0438\u0442\u043e\u0433<a href=\"http:\/\/localhost:8888\/notebooks\/Users\/targetplanet\/Desktop\/dsprog\/dsprog__efphagp3bf\/a-b-testing__ru__efphagp3bf.ipynb#\u041f\u0440\u043e\u043c\u0435\u0436\u0443\u0442\u043e\u0447\u043d\u044b\u0439-\u0438\u0442\u043e\u0433\"><\/a><\/h2>\n\n\n\n<p>\u0423\u0447\u0438\u0442\u044b\u0432\u0430\u044f \u0442\u043e, \u0447\u0442\u043e \u0432\u0441\u0435 \u043f\u043e\u043a\u0430\u0437\u0430\u0442\u0435\u043b\u0438 \u0438\u043c\u0435\u044e\u0442 \u043d\u043e\u0440\u043c\u0430\u043b\u044c\u043d\u043e\u0435 \u0440\u0430\u0441\u043f\u0440\u0435\u0434\u0435\u043b\u0435\u043d\u0438\u0435, \u0430 \u0442\u0430\u043a\u0436\u0435 \u043e\u0442\u0441\u0443\u0442\u0441\u0442\u0432\u0438\u0435 \u0437\u043d\u0430\u0447\u0438\u043c\u044b\u0445 \u0440\u0430\u0437\u043b\u0438\u0447\u0438\u0439 \u0432 \u0432\u0430\u0440\u0438\u0430\u0446\u0438\u044f\u0445 \u043c\u0435\u0436\u0434\u0443 \u0433\u0440\u0443\u043f\u043f\u0430\u043c\u0438, \u0432\u043e\u0437\u043c\u043e\u0436\u043d\u043e \u0437\u0430\u0432\u0435\u0440\u0448\u0438\u0442\u044c \u043f\u0440\u043e\u0446\u0435\u0441\u0441 \u043e\u0431\u0440\u0430\u0431\u043e\u0442\u043a\u0438 \u0434\u0430\u043d\u043d\u044b\u0445.<\/p>\n\n\n\n<p>\u0412\u044b\u0432\u043e\u0434 \u0442\u0430\u043a\u043e\u0432. \u041d\u043e\u0432\u044b\u0439 \u0434\u0438\u0437\u0430\u0439\u043d B \u043e\u043a\u0430\u0437\u044b\u0432\u0430\u0435\u0442 \u0432\u043b\u0438\u044f\u043d\u0438\u0435 \u043d\u0430 \u043f\u043e\u043a\u0430\u0437\u0430\u0442\u0435\u043b\u0438:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Impression,<\/li>\n\n\n\n<li>Click,<\/li>\n\n\n\n<li>Earning<\/li>\n<\/ul>\n\n\n\n<p>\u041d\u043e\u0432\u044b\u0439 \u0434\u0438\u0437\u0430\u0439\u043d B \u043d\u0435 \u043e\u043a\u0430\u0437\u044b\u0432\u0430\u0435\u0442 \u0432\u043b\u0438\u044f\u043d\u0438\u044f \u043d\u0430 \u043f\u043e\u043a\u0430\u0437\u0430\u0442\u0435\u043b\u044c:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Purchase<\/li>\n<\/ul>\n\n\n\n<p>\u041e\u0434\u043d\u0430\u043a\u043e, \u0432\u043e\u0437\u043c\u043e\u0436\u043d\u043e \u0441\u043e\u0437\u0434\u0430\u0442\u044c \u043a\u043e\u043c\u0431\u0438\u043d\u0438\u0440\u043e\u0432\u0430\u043d\u043d\u0443\u044e \u0444\u0443\u043d\u043a\u0446\u0438\u044e \u043a\u043e\u0442\u043e\u0440\u0430\u044f \u0441 \u0443\u0447\u0435\u0442\u043e\u043c \u043d\u043e\u0440\u043c\u0430\u043b\u044c\u043d\u043e\u0441\u0442\u0438, \u0437\u043d\u0430\u0447\u0438\u043c\u043e\u0441\u0442\u0438 \u0432\u0430\u0440\u0438\u0430\u0446\u0438\u0439 \u0438\u0441\u043f\u043e\u043b\u044c\u0437\u043e\u0432\u0430\u043b\u0430 \u043b\u0438\u0431\u043e \u043d\u0435 \u0438\u0441\u043f\u043e\u043b\u044c\u0437\u043e\u0432\u0430\u043b\u0430 \u043a\u0440\u0438\u0442\u0435\u0440\u0438\u0439 U-\u043a\u0440\u0438\u0442\u0435\u0440\u0438\u0439 \u041c\u0430\u043d\u043d\u0430 \u2014 \u0423\u0438\u0442\u043d\u0438 (\u043d\u0435\u043f\u0430\u0440\u0430\u043c\u0435\u0442\u0440\u0438\u0447\u0435\u0441\u043a\u0438\u0439 \u043a\u0440\u0438\u0442\u0435\u0440\u0438\u0439)<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">U-\u043a\u0440\u0438\u0442\u0435\u0440\u0438\u0439 \u041c\u0430\u043d\u043d\u0430 \u2014 \u0423\u0438\u0442\u043d\u0438 \u0432 \u043e\u0431\u0440\u0430\u0431\u043e\u0442\u043a\u0435 \u0434\u0430\u043d\u043d\u044b\u0445<\/h2>\n\n\n\n<pre class=\"EnlighterJSRAW\" data-enlighter-language=\"python\" data-enlighter-theme=\"dracula\" data-enlighter-highlight=\"\" data-enlighter-linenumbers=\"\" data-enlighter-lineoffset=\"\" data-enlighter-title=\"\" data-enlighter-group=\"\">columns = [\"Impression\", \"Click\", \"Purchase\", \"Earning\"]\nfor column in columns:\n    hypothesis_checker(a_group, b_group, column)<\/pre>\n\n\n\n<p>========== Impression ==========<br>*Normalization Check:<br>Shapiro Test for Control Group, Stat = 0.9810, p-value = 0.7250<br>Shapiro Test for Test Group, Stat = 0.9609, p-value = 0.1801<br>*Variance Check:<br>Levene Test Stat = 0.5893, p-value = 0.4450<\/p>\n\n\n\n<p>Independent Samples T Test Stat = -4.1173, p-value = 0.0001<br>H0 hypothesis REJECTED, Independent Samples T Test<\/p>\n\n\n\n<p>========== Click ==========<br>*Normalization Check:<br>Shapiro Test for Control Group, Stat = 0.9882, p-value = 0.9465<br>Shapiro Test for Test Group, Stat = 0.9709, p-value = 0.3851<br>*Variance Check:<br>Levene Test Stat = 0.0978, p-value = 0.7553<\/p>\n\n\n\n<p>Independent Samples T Test Stat = 2.7901, p-value = 0.0066<br>H0 hypothesis REJECTED, Independent Samples T Test<\/p>\n\n\n\n<p>========== Purchase ==========<br>*Normalization Check:<br>Shapiro Test for Control Group, Stat = 0.9775, p-value = 0.5972<br>Shapiro Test for Test Group, Stat = 0.9690, p-value = 0.3341<br>*Variance Check:<br>Levene Test Stat = 0.0232, p-value = 0.8793<\/p>\n\n\n\n<p>Independent Samples T Test Stat = -1.2474, p-value = 0.2160<br>H0 hypothesis NOT REJECTED, Independent Samples T Test<\/p>\n\n\n\n<p>========== Earning ==========<br>*Normalization Check:<br>Shapiro Test for Control Group, Stat = 0.9790, p-value = 0.6524<br>Shapiro Test for Test Group, Stat = 0.9734, p-value = 0.4570<br>*Variance Check:<br>Levene Test Stat = 0.2993, p-value = 0.5859<\/p>\n\n\n\n<p>Independent Samples T Test Stat = -7.0324, p-value = 0.0000<br>H0 hypothesis REJECTED, Independent Samples T Test<\/p>\n\n\n\n<p>\u0420\u0435\u0437\u0443\u043b\u044c\u0442\u0430\u0442\u044b \u043a\u043e\u043c\u0431\u0438\u043d\u0438\u0440\u043e\u0432\u0430\u043d\u043d\u043e\u0439 \u0444\u0443\u043d\u043a\u0446\u0438\u0438 \u043d\u0438\u0447\u0435\u043c \u043d\u0435 \u043e\u0442\u043b\u0438\u0447\u0430\u044e\u0442\u0441\u044f \u043e\u0442 \u0440\u0430\u043d\u0435\u0435 \u043e\u0433\u043b\u0430\u0448\u0435\u043d\u043d\u044b\u0445 \u043f\u0440\u043e\u043c\u0435\u0436\u0443\u0442\u043e\u0447\u043d\u044b\u0445 \u0432\u044b\u0432\u043e\u0434\u043e\u0432. \u041e\u0434\u043d\u0430\u043a\u043e \u0432 \u043d\u0435\u0439 \u0435\u0441\u0442\u044c \u043f\u043e\u0442\u0435\u043d\u0446\u0438\u0430\u043b \u0434\u043b\u044f \u0440\u0430\u0441\u0447\u0435\u0442\u0430 \u0441\u043b\u0443\u0447\u0430\u0435\u0432, \u043a\u043e\u0433\u0434\u0430 \u043d\u0435\u043f\u0430\u0440\u0430\u043c\u0435\u0442\u0440\u0438\u0447\u0435\u0441\u043a\u0438\u0439 \u043a\u0440\u0438\u0442\u0435\u0440\u0438\u0439 \u043d\u0435\u043e\u0431\u0445\u043e\u0434\u0438\u043c.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">\u0412\u044b\u0432\u043e\u0434\u044b<\/h2>\n\n\n\n<p>\u041e\u0431\u0430 \u0432\u0430\u0440\u0438\u0430\u043d\u0442\u0430 \u0434\u0438\u0437\u0430\u0439\u043d\u0430 A \u0438 B \u0445\u0430\u0440\u0430\u043a\u0442\u0435\u0440\u0438\u0437\u0443\u044e\u0442\u0441\u044f \u043f\u043e\u043a\u0430\u0437\u0430\u0442\u0435\u043b\u044f\u043c\u0438 &#171;Impression&#187;, &#171;Click&#187;, &#171;Purchase&#187;, &#171;Earning&#187;.<br>\u041d\u0438 \u043f\u043e \u043e\u0434\u043d\u043e\u043c\u0443 \u0438\u0437 \u043f\u043e\u043a\u0430\u0437\u0430\u0442\u0435\u043b\u0435\u0439: Impression, Click, Purchase \u043d\u0435\u043b\u044c\u0437\u044f \u043e\u0442\u0432\u0435\u0440\u0433\u043d\u0443\u0442\u044c \u043d\u0443\u043b\u0435\u0432\u0443\u044e \u0433\u0438\u043f\u043e\u0442\u0435\u0437\u0443 \u043e \u043d\u043e\u0440\u043c\u0430\u043b\u044c\u043d\u043e\u0441\u0442\u0438 \u0440\u0430\u0441\u043f\u0440\u0435\u0434\u0435\u043b\u0435\u043d\u0438\u044f.<br>\u041d\u0438 \u043f\u043e \u043e\u0434\u043d\u043e\u043c\u0443 \u0438\u0437 \u043f\u043e\u043a\u0430\u0437\u0430\u0442\u0435\u043b\u0435\u0439: Impression, Click, Purchase \u043d\u0435\u043b\u044c\u0437\u044f \u043e\u0442\u0432\u0435\u0440\u0433\u043d\u0443\u0442\u044c \u043d\u0443\u043b\u0435\u0432\u0443\u044e \u0433\u0438\u043f\u043e\u0442\u0435\u0437\u0443 \u043e\u0431 \u043e\u0442\u0441\u0443\u0442\u0441\u0442\u0432\u0438\u0438 \u0437\u043d\u0430\u0447\u0438\u043c\u044b\u0445 \u0440\u0430\u0437\u043b\u0438\u0447\u0438\u0439 \u0432 \u0432\u0430\u0440\u0438\u0430\u0446\u0438\u044f\u0445 \u043c\u0435\u0436\u0434\u0443 \u0433\u0440\u0443\u043f\u043f\u0430\u043c\u0438.<br>\u0414\u0430\u043d\u043d\u044b\u0435 \u0434\u0432\u0430 \u0444\u0430\u043a\u0442\u0430 \u043f\u043e\u0437\u0432\u043e\u043b\u0438\u043b\u0438 \u043f\u0440\u0438\u043c\u0435\u043d\u0438\u0442\u044c \u043f\u0430\u0440\u0430\u043c\u0435\u0442\u0440\u0438\u0447\u0435\u0441\u043a\u0438\u0439 T-\u0442\u0435\u0441\u0442.<br>\u0412 \u0440\u0435\u0437\u0443\u043b\u044c\u0442\u0430\u0442\u0435 \u043f\u0440\u043e\u0432\u0435\u0434\u0435\u043d\u0438\u044f \u0434\u0430\u043d\u043d\u043e\u0433\u043e \u0442\u0435\u0441\u0442\u0430 \u0431\u044b\u043b\u043e \u0432\u044b\u044f\u0432\u043b\u0435\u043d\u043e, \u0447\u0442\u043e \u043b\u0438\u0448\u044c \u0435\u0434\u0438\u043d\u0441\u0442\u0432\u0435\u043d\u043d\u044b\u0439 \u043f\u0430\u0440\u0430\u043c\u0435\u0442\u0440 (Purchase), \u043d\u0435 \u0438\u043c\u0435\u0435\u0442 \u0441\u0442\u0430\u0442\u0438\u0441\u0442\u0438\u0447\u0435\u0441\u043a\u0438 \u0437\u043d\u0430\u0447\u0438\u043c\u0443\u044e \u0440\u0430\u0437\u043d\u0438\u0446\u0443 \u043c\u0435\u0436\u0434\u0443 \u0433\u0440\u0443\u043f\u043f\u043e\u0439 A \u0438 \u0433\u0440\u0443\u043f\u043f\u043e\u0439 B.<br>\u0422\u0430\u043a\u0438\u043c \u043e\u0431\u0440\u0430\u0437\u043e\u043c, \u0441\u0443\u0449\u0435\u0441\u0442\u0432\u0443\u0435\u0442 \u0437\u043d\u0430\u0447\u0438\u0442\u0435\u043b\u044c\u043d\u0430\u044f \u0440\u0430\u0437\u043d\u0438\u0446\u0430 \u0432 \u044d\u0444\u0444\u0435\u043a\u0442\u0438\u0432\u043d\u043e\u0441\u0442\u0438 \u043c\u0435\u0436\u0434\u0443 \u0432\u0430\u0440\u0438\u0430\u043d\u0442\u0430\u043c\u0438 \u0434\u0438\u0437\u0430\u0439\u043d\u0430 A \u0438 B.<\/p>\n\n\n\n<p>\u0414\u043e\u043f\u043e\u043b\u043d\u0438\u0442\u0435\u043b\u044c\u043d\u043e \u0431\u044b\u043b\u0430 \u0441\u043e\u0437\u0434\u0430\u043d\u0430 \u043a\u043e\u043c\u0431\u0438\u043d\u0438\u0440\u043e\u0432\u0430\u043d\u043d\u0430\u044f \u0444\u0443\u043d\u043a\u0446\u0438\u044e \u043a\u043e\u0442\u043e\u0440\u0430\u044f \u0441 \u0443\u0447\u0435\u0442\u043e\u043c \u043d\u043e\u0440\u043c\u0430\u043b\u044c\u043d\u043e\u0441\u0442\u0438, \u0437\u043d\u0430\u0447\u0438\u043c\u043e\u0441\u0442\u0438 \u0432\u0430\u0440\u0438\u0430\u0446\u0438\u0439 \u0438\u0441\u043f\u043e\u043b\u044c\u0437\u0443\u0435\u0442 \u043b\u0438\u0431\u043e \u043d\u0435 \u0438\u0441\u043f\u043e\u043b\u044c\u0437\u0443\u0435\u0442 U-\u043a\u0440\u0438\u0442\u0435\u0440\u0438\u0439 \u041c\u0430\u043d\u043d\u0430 \u2014 \u0423\u0438\u0442\u043d\u0438 (\u043d\u0435\u043f\u0430\u0440\u0430\u043c\u0435\u0442\u0440\u0438\u0447\u0435\u0441\u043a\u0438\u0439 \u043a\u0440\u0438\u0442\u0435\u0440\u0438\u0439). \u0412 \u043d\u0435\u0439 \u0435\u0441\u0442\u044c \u043f\u043e\u0442\u0435\u043d\u0446\u0438\u0430\u043b \u0434\u043b\u044f \u0440\u0430\u0441\u0447\u0435\u0442\u0430 \u0441\u043b\u0443\u0447\u0430\u0435\u0432, \u043a\u043e\u0433\u0434\u0430 \u043d\u0435\u043f\u0430\u0440\u0430\u043c\u0435\u0442\u0440\u0438\u0447\u0435\u0441\u043a\u0438\u0439 \u043a\u0440\u0438\u0442\u0435\u0440\u0438\u0439 \u043d\u0435\u043e\u0431\u0445\u043e\u0434\u0438\u043c.<\/p>\n\n\n\n<p>=======================<\/p>\n\n\n\n<p>\u0414\u043b\u044f \u043f\u043e\u043b\u0443\u0447\u0435\u043d\u0438\u044f \u043f\u043e\u043b\u043d\u043e\u0433\u043e \u043a\u043e\u043d\u0442\u0435\u043d\u0442\u0430 \u0434\u0430\u043d\u043d\u043e\u0439 \u0441\u0442\u0430\u0442\u044c\u0438; \u0434\u043b\u044f \u0441\u043e\u0442\u0440\u0443\u0434\u043d\u0438\u0447\u0435\u0441\u0442\u0432\u0430 \u0441 \u0430\u0432\u0442\u043e\u0440\u043e\u043c, \u043f\u0438\u0448\u0438\u0442\u0435 \u0432 \u0422\u0435\u043b\u0435\u0433\u0440\u0430\u043c: cryptosensors<br>\u041f\u043e\u043b\u043d\u044b\u0439 \u043a\u043e\u043d\u0442\u0435\u043d\u0442 \u0434\u0430\u043d\u043d\u043e\u0439 \u0441\u0442\u0430\u0442\u044c\u0438 \u0432\u043a\u043b\u044e\u0447\u0430\u0435\u0442 \u0444\u0430\u0439\u043b\u044b\/\u0434\u0430\u043d\u043d\u044b\u0435:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>\u0444\u0430\u0439\u043b Jupyter Notebook (ipynb),<\/li>\n\n\n\n<li>\u0444\u0430\u0439\u043b\u044b \u0434\u0430\u0442\u0430\u0441\u0435\u0442\u043e\u0432 (csv \u0438\u043b\u0438 xlsx),<\/li>\n\n\n\n<li>\u043d\u0435\u043e\u043f\u0443\u0431\u043b\u0438\u043a\u043e\u0432\u0430\u043d\u043d\u044b\u0435 \u044d\u043b\u0435\u043c\u0435\u043d\u0442\u044b \u043a\u043e\u0434\u0430, \u043d\u044e\u0430\u043d\u0441\u044b.<\/li>\n<\/ul>\n\n\n\n<p>\u0420\u0430\u0441\u043f\u0440\u043e\u0441\u0442\u0440\u0430\u043d\u0435\u043d\u0438\u0435 \u043c\u0430\u0442\u0435\u0440\u0438\u0430\u043b\u043e\u0432 \u0441 dsprog.pro \u0433\u043e\u0440\u044f\u0447\u043e \u043f\u0440\u0438\u0432\u0435\u0442\u0441\u0442\u0432\u0443\u0435\u0442\u0441\u044f (\u0441 \u0443\u043a\u0430\u0437\u0430\u043d\u0438\u0435\u043c \u0441\u0441\u044b\u043b\u043a\u0438 \u043d\u0430 \u0438\u0441\u0442\u043e\u0447\u043d\u0438\u043a).<\/p>\n","protected":false},"excerpt":{"rendered":"<p>\u0410\u0432\u0442\u043e\u0440: \u0415\u0432\u0433\u0435\u043d\u0438\u0439 \u0411\u043e\u0434\u044f\u0433\u0438\u043d, https:\/\/dsprog.pro \u0412\u0432\u0435\u0434\u0435\u043d\u0438\u0435 \u041d\u0435\u043e\u0431\u0445\u043e\u0434\u0438\u043c\u043e \u043f\u0440\u043e\u0430\u043d\u0430\u043b\u0438\u0437\u0438\u0440\u043e\u0432\u0430\u0442\u044c \u044d\u0444\u0444\u0435\u043a\u0442\u0438\u0432\u043d\u043e\u0441\u0442\u044c \u043d\u043e\u0432\u043e\u0433\u043e \u0434\u0438\u0437\u0430\u0439\u043d\u0430 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u0430. \u0420\u0430\u0441\u043f\u043e\u043b\u0430\u0433\u0430\u0435\u043c \u0434\u0430\u043d\u043d\u044b\u043c\u0438 \u043e \u043f\u043e\u043b\u044c\u0437\u043e\u0432\u0430\u0442\u0435\u043b\u044f\u0445 \u0441\u0430\u0439\u0442\u0430 \u0441\u043e \u0437\u043d\u0430\u0447\u0435\u043d\u0438\u0435\u043c \u043a\u043e\u043d\u0432\u0435\u0440\u0441\u0438\u0438 \u043f\u043e \u043a\u0430\u0436\u0434\u043e\u043c\u0443 \u043f\u043e\u043b\u044c\u0437\u043e\u0432\u0430\u0442\u0435\u043b\u044e\/\u0441\u0435\u0430\u043d\u0441\u0443. \u041f\u0440\u043e\u0432\u0435\u0434\u0435\u043c A-B \u0442\u0435\u0441\u0442. \u041f\u0440\u0435\u0436\u043d\u044e\u044e \u0444\u043e\u0440\u043c\u0443 \u0434\u0438\u0437\u0430\u0439\u043d\u0430 \u043d\u0430\u0437\u043e\u0432\u0435\u043c &#171;\u0410&#187;; \u043d\u043e\u0432\u0443\u044e \u0444\u043e\u0440\u043c\u0443 \u0434\u0438\u0437\u0430\u0439\u043d\u0430 \u043d\u0430\u0437\u043e\u0432\u0435\u043c &#171;B&#187;. \u0414\u0438\u0437\u0430\u0439\u043d \u044d\u043a\u0441\u043f\u0435\u0440\u0438\u043c\u0435\u043d\u0442\u0430 \u0421\u0442\u0440\u0443\u043a\u0442\u0443\u0440\u0430 \u0434\u0430\u043d\u043d\u044b\u0445 \u041e\u043f\u0440\u0435\u0434\u0435\u043b\u0435\u043d\u0438\u0435 \u0443\u0440\u043e\u0432\u043d\u0435\u0439: \u0437\u043d\u0430\u0447\u0438\u043c\u043e\u0441\u0442\u044c \u0442\u0435\u0441\u0442\u0430 \u0438 \u043c\u043e\u0449\u043d\u043e\u0441\u0442\u044c \u0442\u0435\u0441\u0442\u0430 \u0417\u0430\u0433\u0440\u0443\u0437\u043a\u0430 \u0434\u0430\u043d\u043d\u044b\u0445 \u042d\u043a\u0441\u043f\u0435\u0440\u0438\u043c\u0435\u043d\u0442 \u043f\u0440\u043e\u0432\u043e\u0434\u0438\u043b\u0441\u044f \u0432 \u0442\u0435\u0447\u0435\u043d\u0438\u0435 40 \u0434\u043d\u0435\u0439. [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":310,"comment_status":"closed","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"_locale":"ru_RU","_original_post":"https:\/\/dsprog.pro\/?p=260","footnotes":""},"categories":[8,1,4],"tags":[9,16,15,14,20,22,23,21,19],"class_list":["post-295","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-a-b-test","category-data-science","category-python","tag-advertising-effectiveness","tag-data-science","tag-determining-minimum-sample-size","tag-hypothesis-testing","tag-levene-test","tag-mann-whitney-u-test","tag-new-design-effective","tag-shapiro-wilk","tag-t-test","ru-RU","entry","has-media"],"_links":{"self":[{"href":"https:\/\/dsprog.pro\/wp-json\/wp\/v2\/posts\/295","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/dsprog.pro\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/dsprog.pro\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/dsprog.pro\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/dsprog.pro\/wp-json\/wp\/v2\/comments?post=295"}],"version-history":[{"count":16,"href":"https:\/\/dsprog.pro\/wp-json\/wp\/v2\/posts\/295\/revisions"}],"predecessor-version":[{"id":366,"href":"https:\/\/dsprog.pro\/wp-json\/wp\/v2\/posts\/295\/revisions\/366"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/dsprog.pro\/wp-json\/wp\/v2\/media\/310"}],"wp:attachment":[{"href":"https:\/\/dsprog.pro\/wp-json\/wp\/v2\/media?parent=295"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/dsprog.pro\/wp-json\/wp\/v2\/categories?post=295"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/dsprog.pro\/wp-json\/wp\/v2\/tags?post=295"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}