{"id":246,"date":"2023-08-28T19:29:24","date_gmt":"2023-08-28T16:29:24","guid":{"rendered":"https:\/\/dsprog.pro\/?p=246"},"modified":"2023-09-10T07:50:15","modified_gmt":"2023-09-10T04:50:15","slug":"a-b_test_online_store__rj2khks4hn","status":"publish","type":"post","link":"https:\/\/dsprog.pro\/ru\/a-b_test_online_store__rj2khks4hn\/","title":{"rendered":"A-B \u0442\u0435\u0441\u0442. \u042f\u0432\u043b\u044f\u0435\u0442\u0441\u044f \u043b\u0438 \u0438\u043d\u0430\u044f \u0440\u0435\u043a\u043b\u0430\u043c\u043d\u0430\u044f \u043a\u0430\u043c\u043f\u0430\u043d\u0438\u044f \u0431\u043e\u043b\u0435\u0435 \u044d\u0444\u0444\u0435\u043a\u0442\u0438\u0432\u043d\u043e\u0439 \u0434\u043b\u044f \u0438\u043d\u0442\u0435\u0440\u043d\u0435\u0442 \u043c\u0430\u0433\u0430\u0437\u0438\u043d\u0430?"},"content":{"rendered":"\n<p>\u0410\u0432\u0442\u043e\u0440: \u0415\u0432\u0433\u0435\u043d\u0438\u0439 \u0411\u043e\u0434\u044f\u0433\u0438\u043d, https:\/\/dsprog.pro<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"Introduction\">\u0412\u0432\u0435\u0434\u0435\u043d\u0438\u0435<\/h2>\n\n\n\n<p>\u0418\u0442\u0430\u043a, \u0441\u0443\u0449\u0435\u0441\u0442\u0432\u0443\u0435\u0442 \u0438\u043d\u0442\u0435\u0440\u043d\u0435\u0442 \u043c\u0430\u0433\u0430\u0437\u0438\u043d (\u0441\u0430\u0439\u0442). \u041e\u043d \u0443\u0436\u0435 \u043f\u0440\u043e\u0432\u043e\u0434\u0438\u0442 \u0440\u0435\u043a\u043b\u0430\u043c\u043d\u0443\u044e \u043a\u0430\u043c\u043f\u0430\u043d\u0438\u044e A. \u0415\u0441\u0442\u044c \u0442\u0430\u043a\u0436\u0435 \u0430\u043b\u044c\u0442\u0435\u0440\u043d\u0430\u0442\u0438\u0432\u043d\u044b\u0439 \u0432\u0430\u0440\u0438\u0430\u043d\u0442: \u043f\u0440\u043e\u0432\u0435\u0441\u0442\u0438 \u0440\u0435\u043a\u043b\u0430\u043c\u043d\u0443\u044e \u043a\u0430\u043c\u0430\u043d\u0438\u044e B. \u041f\u0440\u043e\u0432\u0435\u0434\u0435\u043c A-B \u0442\u0435\u0441\u0442, \u0434\u0430\u0431\u044b \u0432\u044b\u044f\u0441\u043d\u0438\u0442\u044c: \u043e\u0442\u043b\u0438\u0447\u0430\u0435\u0442\u0441\u044f \u043b\u0438 \u044d\u0444\u0444\u0435\u043a\u0442\u0438\u0432\u043d\u043e\u0441\u0442\u044c \u0434\u0430\u043d\u043d\u044b\u0445 \u043a\u0430\u043c\u043f\u0430\u043d\u0438\u0439?<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"Experiment-Design\">\u0414\u0438\u0437\u0430\u0439\u043d \u044d\u043a\u0441\u043f\u0435\u0440\u0438\u043c\u0435\u043d\u0442\u0430<\/h2>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>\u041d\u0443\u043b\u0435\u0432\u0430\u044f \u0433\u0438\u043f\u043e\u0442\u0435\u0437\u0430<\/strong>: \u041d\u0435\u0442 \u0440\u0430\u0437\u043d\u0438\u0446\u044b \u0432 \u044d\u0444\u0444\u0435\u043a\u0442\u0438\u0432\u043d\u043e\u0441\u0442\u0438 \u043c\u0435\u0436\u0434\u0443 \u0440\u0435\u043a\u043b\u0430\u043c\u043d\u044b\u043c\u0438 \u043a\u0430\u043c\u043f\u0430\u043d\u0438\u044f\u043c\u0438 A \u0438 B.<\/li>\n\n\n\n<li><strong>\u0410\u043b\u044c\u0442\u0435\u0440\u043d\u0430\u0442\u0438\u0432\u043d\u0430\u044f \u0433\u0438\u043f\u043e\u0442\u0435\u0437\u0430<\/strong>: \u0415\u0441\u0442\u044c \u0437\u043d\u0430\u0447\u0438\u0442\u0435\u043b\u044c\u043d\u0430\u044f \u0440\u0430\u0437\u043d\u0438\u0446\u0430 \u0432 \u044d\u0444\u0444\u0435\u043a\u0442\u0438\u0432\u043d\u043e\u0441\u0442\u0438 \u043c\u0435\u0436\u0434\u0443 \u0440\u0435\u043a\u043b\u0430\u043c\u043d\u044b\u043c\u0438 \u043a\u0430\u043c\u043f\u0430\u043d\u0438\u044f\u043c\u0438 A \u0438 B.<\/li>\n\n\n\n<li><strong>\u041e\u0431\u044a\u0435\u043a\u0442 \u043e\u0431\u0440\u0430\u0431\u043e\u0442\u043a\u0438<\/strong>: \u0414\u0432\u0435 \u0432\u044b\u0431\u043e\u0440\u043a\u0438 cookies \u043f\u043e\u0441\u0435\u0442\u0438\u0442\u0435\u043b\u0435\u0439 \u0441\u0430\u0439\u0442\u0430 \u043f\u0435\u0440\u0435\u043c\u0435\u0448\u0430\u043d\u043d\u044b\u0435 \u0441\u043b\u0443\u0447\u0430\u0439\u043d\u044b\u043c \u043e\u0431\u0440\u0430\u0437\u043e\u043c. \u0420\u0430\u0437\u043c\u0435\u0440 \u0432\u044b\u0431\u043e\u0440\u043e\u043a \u043e\u0434\u0438\u043d\u0430\u043a\u043e\u0432.<\/li>\n\n\n\n<li><strong>\u0426\u0435\u043b\u0435\u0432\u0430\u044f \u0430\u0443\u0434\u0438\u0442\u043e\u0440\u0438\u044f<\/strong>: \u041f\u043e\u0441\u0435\u0442\u0438\u0442\u0435\u043b\u0438 \u0441\u0430\u0439\u0442\u0430 \u0437\u0430 \u043f\u043e\u0441\u043b\u0435\u0434\u043d\u0438\u0435 30 \u0434\u043d\u0435\u0439.<\/li>\n\n\n\n<li><strong>\u041c\u0435\u0442\u0440\u0438\u043a\u0438<\/strong>: CTR, CR, CPC, CPA<\/li>\n\n\n\n<li><strong>\u041e\u043f\u0438\u0441\u0430\u043d\u0438\u0435 CTR<\/strong>: (\u043a\u043e\u043b\u0438\u0447\u0435\u0441\u0442\u0432\u043e \u043a\u043b\u0438\u043a\u043d\u0443\u0432\u0448\u0438\u0445) \/ (\u043a\u043e\u043b\u0438\u0447\u0435\u0441\u0442\u0432\u043e \u043f\u043e\u043a\u0430\u0437\u043e\u0432) * 100<\/li>\n\n\n\n<li><strong>\u041e\u043f\u0438\u0441\u0430\u043d\u0438\u0435 CR<\/strong>: (\u043a\u043e\u043b\u0438\u0447\u0435\u0441\u0442\u0432\u043e \u043f\u043e\u043a\u0443\u043f\u043e\u043a) \/ (\u043a\u043e\u043b\u0438\u0447\u0435\u0441\u0442\u0432\u043e \u043a\u043b\u0438\u043a\u043d\u0443\u0432\u0448\u0438\u0445) * 100<\/li>\n\n\n\n<li><strong>\u041e\u043f\u0438\u0441\u0430\u043d\u0438\u0435 CPC<\/strong>: (\u0437\u0430\u0442\u0440\u0430\u0442\u044b \u0432 USD) \/ (\u043a\u043e\u043b\u0438\u0447\u0435\u0441\u0442\u0432\u043e \u043a\u043b\u0438\u043a\u043d\u0443\u0432\u0448\u0438\u0445) * 100<\/li>\n\n\n\n<li><strong>\u041e\u043f\u0438\u0441\u0430\u043d\u0438\u0435 CPA<\/strong>: (\u0437\u0430\u0442\u0440\u0430\u0442\u044b \u0432 USD) \/ (\u043a\u043e\u043b\u0438\u0447\u0435\u0441\u0442\u0432\u043e \u043f\u043e\u043a\u0443\u043f\u043e\u043a) * 100<\/li>\n\n\n\n<li><strong>\u0414\u043b\u0438\u0442\u0435\u043b\u044c\u043d\u043e\u0441\u0442\u044c \u043f\u0440\u043e\u0432\u0435\u0434\u0435\u043d\u0438\u044f \u0442\u0435\u0441\u0442\u0430<\/strong>: 1 \u043c\u0435\u0441\u044f\u0446<\/li>\n\n\n\n<li><strong>\u0423\u0440\u043e\u0432\u043d\u0438 \u0437\u043d\u0430\u0447\u0438\u043c\u043e\u0441\u0442\u0438<\/strong>:<\/li>\n\n\n\n<li><strong>\u03b1<\/strong> = 0.05<\/li>\n\n\n\n<li><strong>\u03b2<\/strong> = 0.2<\/li>\n\n\n\n<li>\u041a\u0430\u043c\u043f\u0430\u043d\u0438\u0438 \u0437\u0430\u043f\u0443\u0441\u043a\u0430\u044e\u0442\u0441\u044f \u043e\u0434\u043d\u043e\u0432\u0440\u0435\u043c\u0435\u043d\u043d\u043e, \u0430 \u0430\u0443\u0434\u0438\u0442\u043e\u0440\u0438\u044f \u0434\u0435\u043b\u0438\u0442\u0441\u044f \u0441\u043b\u0443\u0447\u0430\u0439\u043d\u044b\u043c \u043e\u0431\u0440\u0430\u0437\u043e\u043c.<\/li>\n<\/ul>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"Leveling:-Test-Significance-and-Test-Power\">\u041e\u043f\u0440\u0435\u0434\u0435\u043b\u0435\u043d\u0438\u0435 \u0443\u0440\u043e\u0432\u043d\u0435\u0439: \u0437\u043d\u0430\u0447\u0438\u043c\u043e\u0441\u0442\u044c \u0442\u0435\u0441\u0442\u0430 \u0438 \u043c\u043e\u0449\u043d\u043e\u0441\u0442\u044c \u0442\u0435\u0441\u0442\u0430<\/h2>\n\n\n\n<pre class=\"EnlighterJSRAW\" data-enlighter-language=\"python\" data-enlighter-theme=\"dracula\" data-enlighter-highlight=\"\" data-enlighter-linenumbers=\"\" data-enlighter-lineoffset=\"\" data-enlighter-title=\"\" data-enlighter-group=\"\">import scipy\n# \u0423\u0440\u043e\u0432\u0435\u043d\u044c \u0437\u043d\u0430\u0447\u0438\u043c\u043e\u0441\u0442\u0438 (\u0432\u0435\u0440\u043e\u044f\u0442\u043d\u043e\u0441\u0442\u044c \u043e\u0448\u0438\u0431\u043a\u0438 \u043f\u0435\u0440\u0432\u043e\u0433\u043e \u0440\u043e\u0434\u0430), \u043a\u043e\u0442\u043e\u0440\u044b\u0439 \u0438\u0441\u043f\u043e\u043b\u044c\u0437\u0443\u0435\u0442\u0441\u044f \u0434\u043b\u044f \u043f\u0440\u0438\u043d\u044f\u0442\u0438\u044f \u0440\u0435\u0448\u0435\u043d\u0438\u044f \u043e\u0431 \u043e\u0442\u043a\u043b\u043e\u043d\u0435\u043d\u0438\u0438 \u043d\u0443\u043b\u0435\u0432\u043e\u0439 \u0433\u0438\u043f\u043e\u0442\u0435\u0437\u044b.\nalpha = 0.05 \n# \u041c\u043e\u0449\u043d\u043e\u0441\u0442\u044c \u0442\u0435\u0441\u0442\u0430 (\u0432\u0435\u0440\u043e\u044f\u0442\u043d\u043e\u0441\u0442\u044c \u043e\u0448\u0438\u0431\u043a\u0438 \u0432\u0442\u043e\u0440\u043e\u0433\u043e \u0440\u043e\u0434\u0430), \u043a\u043e\u0442\u043e\u0440\u0430\u044f \u0443\u043a\u0430\u0437\u044b\u0432\u0430\u0435\u0442 \u043d\u0430 \u0432\u0435\u0440\u043e\u044f\u0442\u043d\u043e\u0441\u0442\u044c \u043d\u0435\u043e\u0431\u043d\u0430\u0440\u0443\u0436\u0435\u043d\u0438\u044f \u0440\u0435\u0430\u043b\u044c\u043d\u043e\u0433\u043e \u044d\u0444\u0444\u0435\u043a\u0442\u0430 \u043f\u0440\u0438 \u0435\u0433\u043e \u043d\u0430\u043b\u0438\u0447\u0438\u0438.\nbeta = 0.2 \nalpha_zscore = -1 * round(scipy.stats.norm.ppf(1 - alpha\/2), 4)\nbeta_zscore = -1 * round(scipy.stats.norm.ppf(1 - beta), 4)\nprint('alpha_zscore: ', alpha_zscore)\nprint('beta_zscore: ', beta_zscore)<\/pre>\n\n\n\n<p>alpha_zscore: -1.96 beta_zscore: -0.8416<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">\u041e\u043f\u0440\u0435\u0434\u0435\u043b\u0435\u043d\u0438\u0435 \u043c\u0438\u043d\u0438\u043c\u0430\u043b\u044c\u043d\u043e\u0433\u043e \u0440\u0430\u0437\u043c\u0435\u0440\u0430 \u0432\u044b\u0431\u043e\u0440\u043a\u0438<\/h2>\n\n\n\n<pre class=\"EnlighterJSRAW\" data-enlighter-language=\"python\" data-enlighter-theme=\"dracula\" data-enlighter-highlight=\"\" data-enlighter-linenumbers=\"\" data-enlighter-lineoffset=\"\" data-enlighter-title=\"\" data-enlighter-group=\"\">import pandas as pd\nimport numpy as np\nimport matplotlib.pyplot as plt\nimport seaborn as sns\nfrom scipy import stats\nsns.set()\n\n# \u041d\u0430\u0447\u0430\u043b\u044c\u043d\u0430\u044f \u043a\u043e\u043d\u0432\u0435\u0440\u0441\u0438\u044f, \u043a\u043e\u0442\u043e\u0440\u0430\u044f \u043f\u0440\u0438\u043d\u0438\u043c\u0430\u0435\u0442\u0441\u044f \u0432 \u043a\u0430\u0447\u0435\u0441\u0442\u0432\u0435 \u043e\u0442\u043f\u0440\u0430\u0432\u043d\u043e\u0439 \u0442\u043e\u0447\u043a\u0438 \u0434\u043b\u044f \u0441\u0440\u0430\u0432\u043d\u0435\u043d\u0438\u044f \u0441 \u0434\u0440\u0443\u0433\u0438\u043c\u0438 \u0432\u0430\u0440\u0438\u0430\u043d\u0442\u0430\u043c\u0438:\nbaseline_cr = 0.095\n# \u041c\u0438\u043d\u0438\u043c\u0430\u043b\u044c\u043d\u044b\u0439 \u043e\u0431\u043d\u0430\u0440\u0443\u0436\u0438\u0432\u0430\u0435\u043c\u044b\u0439 \u044d\u0444\u0444\u0435\u043a\u0442:\nmin_detectable_effect = 0.005\n# this content is from dsprog.pro\np2 = baseline_cr + min_detectable_effect\n\nn = (((alpha_zscore * np.sqrt(2 * baseline_cr * (1 - baseline_cr))) + (beta_zscore * np.sqrt(baseline_cr * (1 - baseline_cr) + p2 * (1 - p2))))**2) \/ (abs(p2 - baseline_cr)**2)\nprint('Sample Size: ', round(n, 0))<\/pre>\n\n\n\n<p>Sample Size: 54363.0<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"Data-structure\">\u0421\u0442\u0440\u0443\u043a\u0442\u0443\u0440\u0430 \u0434\u0430\u043d\u043d\u044b\u0445<a href=\"http:\/\/localhost:8888\/notebooks\/Users\/targetplanet\/Desktop\/dsprog\/dsprog__rj2khks4hn\/dsprog__rj2khks4hn\/A-B_test_online_store__ru__rj2khks4hn.ipynb#\u0421\u0442\u0440\u0443\u043a\u0442\u0443\u0440\u0430-\u0434\u0430\u043d\u043d\u044b\u0445\"><\/a><\/h2>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>\u0420\u0435\u043a\u043b\u0430\u043c\u043d\u0430\u044f \u043a\u0430\u043c\u043f\u0430\u043d\u0438\u044f (Campaign Name):<\/strong> \u041d\u0430\u0437\u0432\u0430\u043d\u0438\u0435 \u0440\u0435\u043a\u043b\u0430\u043c\u043d\u043e\u0439 \u043a\u0430\u043c\u043f\u0430\u043d\u0438\u0438.<\/li>\n\n\n\n<li><strong>\u0414\u0430\u0442\u0430 (Date):<\/strong> \u0414\u0430\u0442\u0430 \u043f\u0440\u043e\u0432\u0435\u0434\u0435\u043d\u0438\u044f \u0440\u0435\u043a\u043b\u0430\u043c\u043d\u043e\u0439 \u043a\u0430\u043c\u043f\u0430\u043d\u0438\u0438.<\/li>\n\n\n\n<li><strong>\u041f\u043e\u043a\u0430\u0437\u044b (of Impressions):<\/strong> \u041a\u043e\u043b\u0438\u0447\u0435\u0441\u0442\u0432\u043e \u043f\u043e\u043a\u0430\u0437\u043e\u0432 \u0440\u0435\u043a\u043b\u0430\u043c\u044b.<\/li>\n\n\n\n<li><strong>\u041e\u0445\u0432\u0430\u0442 (Reach):<\/strong> \u041e\u0445\u0432\u0430\u0442 \u0430\u0443\u0434\u0438\u0442\u043e\u0440\u0438\u0438, \u043a\u043e\u043b\u0438\u0447\u0435\u0441\u0442\u0432\u043e \u0443\u043d\u0438\u043a\u0430\u043b\u044c\u043d\u044b\u0445 \u043f\u043e\u043b\u044c\u0437\u043e\u0432\u0430\u0442\u0435\u043b\u0435\u0439, \u0443\u0432\u0438\u0434\u0435\u0432\u0448\u0438\u0445 \u0440\u0435\u043a\u043b\u0430\u043c\u0443. \u041f\u043e\u0437\u0432\u043e\u043b\u044f\u0435\u0442 \u043e\u043f\u0440\u0435\u0434\u0435\u043b\u0438\u0442\u044c, \u0441\u043a\u043e\u043b\u044c\u043a\u043e \u043b\u044e\u0434\u0435\u0439 \u0443\u0437\u043d\u0430\u043b\u043e \u043e \u0440\u0435\u043a\u043b\u0430\u043c\u0435.<\/li>\n\n\n\n<li><strong>\u041a\u043b\u0438\u043a\u0438 (of Website Clicks):<\/strong> \u041a\u043e\u043b\u0438\u0447\u0435\u0441\u0442\u0432\u043e \u043a\u043b\u0438\u043a\u043e\u0432 \u043d\u0430 \u0431\u0430\u043d\u043d\u0435\u0440 \u0438 \u043f\u0435\u0440\u0435\u0448\u043b\u0438 \u043d\u0430 \u0441\u0430\u0439\u0442.<\/li>\n\n\n\n<li><strong>\u041f\u0440\u043e\u0441\u043c\u043e\u0442\u0440 \u043a\u043e\u043d\u0442\u0435\u043d\u0442\u0430 (of View Content):<\/strong> \u0421\u043a\u043e\u043b\u044c\u043a\u043e \u0440\u0430\u0437 \u043f\u043e\u043b\u044c\u0437\u043e\u0432\u0430\u0442\u0435\u043b\u0438 \u043f\u0440\u043e\u0441\u043c\u043e\u0442\u0440\u0435\u043b\u0438 \u043a\u043e\u043d\u0442\u0435\u043d\u0442 \u043d\u0430 \u0441\u0430\u0439\u0442\u0435.<\/li>\n\n\n\n<li><strong>\u0414\u043e\u0431\u0430\u0432\u043b\u0435\u043d\u0438\u0439 \u0432 \u043a\u043e\u0440\u0437\u0438\u043d\u0443 (of Add to Cart):<\/strong> \u0421\u043a\u043e\u043b\u044c\u043a\u043e \u0440\u0430\u0437 \u043f\u043e\u043b\u044c\u0437\u043e\u0432\u0430\u0442\u0435\u043b\u0438 \u0434\u043e\u0431\u0430\u0432\u0438\u043b\u0438 \u0442\u043e\u0432\u0430\u0440\u044b \u0432 \u043a\u043e\u0440\u0437\u0438\u043d\u0443 \u043f\u043e\u043a\u0443\u043f\u043e\u043a.<\/li>\n\n\n\n<li><strong>\u041f\u043e\u043a\u0443\u043f\u043a\u0438 (of Purchase):<\/strong> \u0421\u043a\u043e\u043b\u044c\u043a\u043e \u0440\u0430\u0437 \u043f\u043e\u043b\u044c\u0437\u043e\u0432\u0430\u0442\u0435\u043b\u0438 \u0441\u043e\u0432\u0435\u0440\u0448\u0438\u043b\u0438 \u043f\u043e\u043a\u0443\u043f\u043a\u0443.<\/li>\n\n\n\n<li><strong>\u0417\u0430\u0442\u0440\u0430\u0442\u044b (Spend \/USD\/):<\/strong> \u0417\u0430\u0442\u0440\u0430\u0442\u044b \u043d\u0430 \u0440\u0435\u043a\u043b\u0430\u043c\u0443.<\/li>\n\n\n\n<li><strong>\u0417\u0430\u043f\u0440\u043e\u0441\u044b (of Searches):<\/strong> \u0421\u043a\u043e\u043b\u044c\u043a\u043e \u0440\u0430\u0437 \u043f\u043e\u043b\u044c\u0437\u043e\u0432\u0430\u0442\u0435\u043b\u0438 \u043f\u0440\u043e\u0438\u0437\u0432\u0435\u043b\u0438 \u043f\u043e\u0438\u0441\u043a \u043d\u0430 \u0441\u0430\u0439\u0442\u0435 \u043f\u043e\u0441\u043b\u0435 \u043a\u043b\u0438\u043a\u0430.<\/li>\n<\/ul>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"Loading-data\">\u0417\u0430\u0433\u0440\u0443\u0437\u043a\u0430 \u0434\u0430\u043d\u043d\u044b\u0445<a href=\"http:\/\/localhost:8888\/notebooks\/Users\/targetplanet\/Desktop\/dsprog\/dsprog__rj2khks4hn\/dsprog__rj2khks4hn\/A-B_test_online_store__ru__rj2khks4hn.ipynb#\u0417\u0430\u0433\u0440\u0443\u0437\u043a\u0430-\u0434\u0430\u043d\u043d\u044b\u0445\"><\/a><a href=\"http:\/\/localhost:8888\/notebooks\/Users\/targetplanet\/Desktop\/dsprog\/dsprog__rj2khks4hn\/dsprog__rj2khks4hn\/A-B_test_online_store__en__rj2khks4hn.ipynb#Loading-data\"><\/a><\/h2>\n\n\n\n<p>\u042d\u043a\u0441\u043f\u0435\u0440\u0438\u043c\u0435\u043d\u0442 \u043f\u0440\u043e\u0432\u043e\u0434\u0438\u043b\u0441\u044f \u0432 \u0442\u0435\u0447\u0435\u043d\u0438\u0435 1 \u043c\u0435\u0441\u044f\u0446\u0430. \u0417\u0430\u0433\u0440\u0443\u0437\u0438\u043c \u0438\u043c\u0435\u044e\u0449\u0438\u0435\u0441\u044f \u0434\u0430\u043d\u043d\u044b\u0435.<\/p>\n\n\n\n<pre class=\"EnlighterJSRAW\" data-enlighter-language=\"python\" data-enlighter-theme=\"dracula\" data-enlighter-highlight=\"\" data-enlighter-linenumbers=\"\" data-enlighter-lineoffset=\"\" data-enlighter-title=\"\" data-enlighter-group=\"\">a_group = pd.read_csv('input\/Xa_group.csv', delimiter=',')\na_group['Date'] = pd.to_datetime(a_group['Date'], format='%Y-%m-%d', dayfirst=True)\na_group.head()<\/pre>\n\n\n\n<figure class=\"wp-block-table\"><table><thead><tr><th><\/th><th>Campaign Name<\/th><th>Date<\/th><th># of Impressions<\/th><th># Reach<\/th><th># of Website Clicks<\/th><th># of View Content<\/th><th># of Add to Cart<\/th><th># of Purchase<\/th><th># Spend [USD]<\/th><th># of Searches<\/th><\/tr><\/thead><tbody><tr><th>0<\/th><td>a campaign<\/td><td>2023-07-27<\/td><td>36908<\/td><td>104034<\/td><td>1024<\/td><td>2485<\/td><td>1028<\/td><td>521<\/td><td>2158<\/td><td>2609<\/td><\/tr><tr><th>1<\/th><td>a campaign<\/td><td>2023-07-19<\/td><td>129930<\/td><td>78269<\/td><td>2557<\/td><td>1568<\/td><td>1250<\/td><td>882<\/td><td>1979<\/td><td>1223<\/td><\/tr><tr><th>2<\/th><td>a campaign<\/td><td>2023-07-18<\/td><td>94853<\/td><td>110617<\/td><td>3126<\/td><td>2719<\/td><td>2173<\/td><td>922<\/td><td>2547<\/td><td>1415<\/td><\/tr><tr><th>3<\/th><td>a campaign<\/td><td>2023-07-30<\/td><td>152514<\/td><td>89152<\/td><td>3127<\/td><td>1955<\/td><td>1137<\/td><td>218<\/td><td>2454<\/td><td>2340<\/td><\/tr><tr><th>4<\/th><td>a campaign<\/td><td>2023-07-25<\/td><td>100917<\/td><td>91991<\/td><td>3448<\/td><td>2056<\/td><td>793<\/td><td>490<\/td><td>2356<\/td><td>1474<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<pre class=\"EnlighterJSRAW\" data-enlighter-language=\"python\" data-enlighter-theme=\"dracula\" data-enlighter-highlight=\"\" data-enlighter-linenumbers=\"\" data-enlighter-lineoffset=\"\" data-enlighter-title=\"\" data-enlighter-group=\"\">b_group = pd.read_csv('input\/Xb_group.csv', delimiter=',')\nb_group['Date'] = pd.to_datetime(b_group['Date'], format='%Y-%m-%d', dayfirst=True)\nb_group.head()<\/pre>\n\n\n\n<figure class=\"wp-block-table\"><table><thead><tr><th><\/th><th>Campaign Name<\/th><th>Date<\/th><th># of Impressions<\/th><th># Reach<\/th><th># of Website Clicks<\/th><th># of View Content<\/th><th># of Add to Cart<\/th><th># of Purchase<\/th><th># Spend [USD]<\/th><th># of Searches<\/th><\/tr><\/thead><tbody><tr><th>0<\/th><td>b campaign<\/td><td>2023-07-01<\/td><td>79051<\/td><td>47257<\/td><td>7431<\/td><td>1636<\/td><td>989<\/td><td>707<\/td><td>2397<\/td><td>2424<\/td><\/tr><tr><th>1<\/th><td>b campaign<\/td><td>2023-07-02<\/td><td>90101<\/td><td>63332<\/td><td>6070<\/td><td>2208<\/td><td>763<\/td><td>687<\/td><td>1996<\/td><td>1733<\/td><\/tr><tr><th>2<\/th><td>b campaign<\/td><td>2023-07-03<\/td><td>113952<\/td><td>52829<\/td><td>5376<\/td><td>1834<\/td><td>934<\/td><td>466<\/td><td>2223<\/td><td>2455<\/td><\/tr><tr><th>3<\/th><td>b campaign<\/td><td>2023-07-04<\/td><td>73913<\/td><td>105952<\/td><td>9453<\/td><td>3724<\/td><td>1416<\/td><td>218<\/td><td>2974<\/td><td>1263<\/td><\/tr><tr><th>4<\/th><td>b campaign<\/td><td>2023-07-05<\/td><td>59248<\/td><td>28222<\/td><td>8436<\/td><td>959<\/td><td>388<\/td><td>346<\/td><td>2734<\/td><td>1258<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\">\u0420\u0430\u0441\u0447\u0435\u0442 \u043c\u0435\u0442\u0440\u0438\u043a<\/h2>\n\n\n\n<pre class=\"EnlighterJSRAW\" data-enlighter-language=\"python\" data-enlighter-theme=\"dracula\" data-enlighter-highlight=\"\" data-enlighter-linenumbers=\"\" data-enlighter-lineoffset=\"\" data-enlighter-title=\"\" data-enlighter-group=\"\">a_group['CTR'] = a_group['# of Website Clicks']\/a_group['# of Impressions']\na_group['CR'] = a_group['# of Purchase']\/a_group['# of Website Clicks']\na_group['CPC'] = a_group['# Spend [USD]']\/a_group['# of Website Clicks']\na_group['CPA'] = a_group['# Spend [USD]']\/a_group['# of Purchase']\n\nb_group['CTR'] = b_group['# of Website Clicks']\/b_group['# of Impressions']\nb_group['CR'] = b_group['# of Purchase']\/b_group['# of Website Clicks']\nb_group['CPC'] = b_group['# Spend [USD]']\/b_group['# of Website Clicks']\nb_group['CPA'] = b_group['# Spend [USD]']\/b_group['# of Purchase']\n# this content is from dsprog.pro\n\na_group.head()<\/pre>\n\n\n\n<figure class=\"wp-block-table\"><table><thead><tr><th><\/th><th>Campaign Name<\/th><th>Date<\/th><th># of Impressions<\/th><th># Reach<\/th><th># of Website Clicks<\/th><th># of View Content<\/th><th># of Add to Cart<\/th><th># of Purchase<\/th><th># Spend [USD]<\/th><th># of Searches<\/th><th>CTR<\/th><th>CR<\/th><th>CPC<\/th><th>CPA<\/th><\/tr><\/thead><tbody><tr><th>0<\/th><td>a campaign<\/td><td>2023-07-27<\/td><td>36908<\/td><td>104034<\/td><td>1024<\/td><td>2485<\/td><td>1028<\/td><td>521<\/td><td>2158<\/td><td>2609<\/td><td>0.027745<\/td><td>0.508789<\/td><td>2.107422<\/td><td>4.142035<\/td><\/tr><tr><th>1<\/th><td>a campaign<\/td><td>2023-07-19<\/td><td>129930<\/td><td>78269<\/td><td>2557<\/td><td>1568<\/td><td>1250<\/td><td>882<\/td><td>1979<\/td><td>1223<\/td><td>0.019680<\/td><td>0.344935<\/td><td>0.773954<\/td><td>2.243764<\/td><\/tr><tr><th>2<\/th><td>a campaign<\/td><td>2023-07-18<\/td><td>94853<\/td><td>110617<\/td><td>3126<\/td><td>2719<\/td><td>2173<\/td><td>922<\/td><td>2547<\/td><td>1415<\/td><td>0.032956<\/td><td>0.294946<\/td><td>0.814779<\/td><td>2.762473<\/td><\/tr><tr><th>3<\/th><td>a campaign<\/td><td>2023-07-30<\/td><td>152514<\/td><td>89152<\/td><td>3127<\/td><td>1955<\/td><td>1137<\/td><td>218<\/td><td>2454<\/td><td>2340<\/td><td>0.020503<\/td><td>0.069715<\/td><td>0.784778<\/td><td>11.256881<\/td><\/tr><tr><th>4<\/th><td>a campaign<\/td><td>2023-07-25<\/td><td>100917<\/td><td>91991<\/td><td>3448<\/td><td>2056<\/td><td>793<\/td><td>490<\/td><td>2356<\/td><td>1474<\/td><td>0.034167<\/td><td>0.142111<\/td><td>0.683295<\/td><td>4.808163<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<pre class=\"EnlighterJSRAW\" data-enlighter-language=\"python\" data-enlighter-theme=\"dracula\" data-enlighter-highlight=\"\" data-enlighter-linenumbers=\"\" data-enlighter-lineoffset=\"\" data-enlighter-title=\"\" data-enlighter-group=\"\">b_group.head()<\/pre>\n\n\n\n<figure class=\"wp-block-table\"><table><thead><tr><th><\/th><th>Campaign Name<\/th><th>Date<\/th><th># of Impressions<\/th><th># Reach<\/th><th># of Website Clicks<\/th><th># of View Content<\/th><th># of Add to Cart<\/th><th># of Purchase<\/th><th># Spend [USD]<\/th><th># of Searches<\/th><th>CTR<\/th><th>CR<\/th><th>CPC<\/th><th>CPA<\/th><\/tr><\/thead><tbody><tr><th>0<\/th><td>b campaign<\/td><td>2023-07-01<\/td><td>79051<\/td><td>47257<\/td><td>7431<\/td><td>1636<\/td><td>989<\/td><td>707<\/td><td>2397<\/td><td>2424<\/td><td>0.094003<\/td><td>0.095142<\/td><td>0.322568<\/td><td>3.390382<\/td><\/tr><tr><th>1<\/th><td>b campaign<\/td><td>2023-07-02<\/td><td>90101<\/td><td>63332<\/td><td>6070<\/td><td>2208<\/td><td>763<\/td><td>687<\/td><td>1996<\/td><td>1733<\/td><td>0.067369<\/td><td>0.113180<\/td><td>0.328830<\/td><td>2.905386<\/td><\/tr><tr><th>2<\/th><td>b campaign<\/td><td>2023-07-03<\/td><td>113952<\/td><td>52829<\/td><td>5376<\/td><td>1834<\/td><td>934<\/td><td>466<\/td><td>2223<\/td><td>2455<\/td><td>0.047178<\/td><td>0.086682<\/td><td>0.413504<\/td><td>4.770386<\/td><\/tr><tr><th>3<\/th><td>b campaign<\/td><td>2023-07-04<\/td><td>73913<\/td><td>105952<\/td><td>9453<\/td><td>3724<\/td><td>1416<\/td><td>218<\/td><td>2974<\/td><td>1263<\/td><td>0.127894<\/td><td>0.023061<\/td><td>0.314609<\/td><td>13.642202<\/td><\/tr><tr><th>4<\/th><td>b campaign<\/td><td>2023-07-05<\/td><td>59248<\/td><td>28222<\/td><td>8436<\/td><td>959<\/td><td>388<\/td><td>346<\/td><td>2734<\/td><td>1258<\/td><td>0.142385<\/td><td>0.041015<\/td><td>0.324087<\/td><td>7.901734<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\">\u0417\u0430\u0442\u0440\u0430\u0442\u044b \u043d\u0430 \u0440\u0435\u043a\u043b\u0430\u043c\u0443<\/h2>\n\n\n\n<pre class=\"EnlighterJSRAW\" data-enlighter-language=\"python\" data-enlighter-theme=\"dracula\" data-enlighter-highlight=\"\" data-enlighter-linenumbers=\"\" data-enlighter-lineoffset=\"\" data-enlighter-title=\"\" data-enlighter-group=\"\">fig, ax = plt.subplots(ncols=2, figsize=(14,6))\n\nax1 = sns.kdeplot(a_group['# Spend [USD]'], ax=ax[0], color='green', fill=True)\nax2 = sns.kdeplot(b_group['# Spend [USD]'], ax=ax[1], color='green', fill=True)\nax1.set_title('a campaign')\nax2.set_title('b campaign')\n\nplt.show()<\/pre>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"1204\" height=\"556\" src=\"https:\/\/dsprog.pro\/wp-content\/uploads\/2023\/08\/rj2khks4hn_0.png\" alt=\"\" class=\"wp-image-213\"\/><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\">\u041f\u043e\u043a\u0430\u0437\u044b<\/h2>\n\n\n\n<pre class=\"EnlighterJSRAW\" data-enlighter-language=\"python\" data-enlighter-theme=\"dracula\" data-enlighter-highlight=\"\" data-enlighter-linenumbers=\"\" data-enlighter-lineoffset=\"\" data-enlighter-title=\"\" data-enlighter-group=\"\">fig, ax = plt.subplots(ncols=2, figsize=(14,6))\n\nax1 = sns.kdeplot(a_group['# of Impressions'], ax=ax[0], color='blue', fill=True)\nax2 = sns.kdeplot(b_group['# of Impressions'], ax=ax[1], color='blue', fill=True)\nax1.set_title('a group impressions')\nax2.set_title('b group impressions')\n# this content is from dsprog.pro\nplt.show()<\/pre>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"1165\" height=\"556\" src=\"https:\/\/dsprog.pro\/wp-content\/uploads\/2023\/08\/rj2khks4hn_1.png\" alt=\"\" class=\"wp-image-215\"\/><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\">\u041a\u043b\u0438\u043a\u0438<\/h2>\n\n\n\n<pre class=\"EnlighterJSRAW\" data-enlighter-language=\"python\" data-enlighter-theme=\"dracula\" data-enlighter-highlight=\"\" data-enlighter-linenumbers=\"\" data-enlighter-lineoffset=\"\" data-enlighter-title=\"\" data-enlighter-group=\"\">fig, ax = plt.subplots(ncols=2, figsize=(14,6))\nax1 = sns.kdeplot(a_group['# of Website Clicks'], ax=ax[0], color='gray', fill=True)\nax2 = sns.kdeplot(b_group['# of Website Clicks'], ax=ax[1], color='gray', fill=True)\nax1.set_title('a group clicks')\nax2.set_title('b group clicks')\n# this content is from dsprog.pro\nplt.show()<\/pre>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"1210\" height=\"556\" src=\"https:\/\/dsprog.pro\/wp-content\/uploads\/2023\/08\/rj2khks4hn_2.png\" alt=\"\" class=\"wp-image-218\"\/><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\">\u041f\u043e\u043a\u0443\u043f\u043a\u0438<\/h2>\n\n\n\n<pre class=\"EnlighterJSRAW\" data-enlighter-language=\"python\" data-enlighter-theme=\"dracula\" data-enlighter-highlight=\"\" data-enlighter-linenumbers=\"\" data-enlighter-lineoffset=\"\" data-enlighter-title=\"\" data-enlighter-group=\"\">fig, ax = plt.subplots(ncols=2, figsize=(14,6))\n\nax1 = sns.kdeplot(a_group['# of Purchase'], ax=ax[0], color='red', fill=True)\nax2 = sns.kdeplot(b_group['# of Purchase'], ax=ax[1], color='red', fill=True)\nax1.set_title('a group purchases')\nax2.set_title('b group purchases')\n\nplt.show()<\/pre>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"1194\" height=\"556\" src=\"https:\/\/dsprog.pro\/wp-content\/uploads\/2023\/08\/rj2khks4hn_3.png\" alt=\"\" class=\"wp-image-220\"\/><\/figure>\n\n\n\n<p>\u041e\u0431\u044a\u0435\u043c \u0432\u044b\u0431\u043e\u0440\u043e\u043a A \u0438 B \u0441\u043e\u043f\u043e\u0441\u0442\u0430\u0432\u0438\u043c \u0438, \u043f\u043e\u0445\u043e\u0436\u0435, \u0441\u043e\u043e\u0442\u0432\u0435\u0442\u0441\u0442\u0432\u0443\u0435\u0442 \u043d\u043e\u0440\u043c\u0430\u043b\u044c\u043d\u043e\u043c\u0443 \u0440\u0430\u0441\u043f\u0440\u0435\u0434\u0435\u043b\u0435\u043d\u0438\u044e.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">\u041e\u043f\u0438\u0441\u0430\u0442\u0435\u043b\u044c\u043d\u044b\u0435 \u0441\u0442\u0430\u0442\u0438\u0441\u0442\u0438\u043a\u0438<\/h2>\n\n\n\n<pre class=\"EnlighterJSRAW\" data-enlighter-language=\"python\" data-enlighter-theme=\"dracula\" data-enlighter-highlight=\"\" data-enlighter-linenumbers=\"\" data-enlighter-lineoffset=\"\" data-enlighter-title=\"\" data-enlighter-group=\"\">print(a_group['# of Impressions'].describe())\nprint(b_group['# of Impressions'].describe())<\/pre>\n\n\n\n<p>count 30.000000<br>mean 113051.066667 <br>std 32856.443638 <br>min 36908.000000 <br>25% 98280.750000 <br>50% 114663.500000 <br>75% 133569.000000 <br>max 173904.000000 <br>Name: # of Impressions, dtype: float64 <br><br>count 30.000000 <br>mean 79364.766667 <br>std 29599.412623 <br>min 24610.000000 <br>25% 56291.500000 <br>50% 72544.500000 <br>75% 97436.750000 <br>max 162153.000000 <br>Name: # of Impressions, dtype: float64<\/p>\n\n\n\n<pre class=\"EnlighterJSRAW\" data-enlighter-language=\"python\" data-enlighter-theme=\"dracula\" data-enlighter-highlight=\"\" data-enlighter-linenumbers=\"\" data-enlighter-lineoffset=\"\" data-enlighter-title=\"\" data-enlighter-group=\"\">print(a_group['# of Website Clicks'].describe())\nprint(b_group['# of Website Clicks'].describe())<\/pre>\n\n\n\n<p>count 30.000000 <br>mean 4994.633333 <br>std 1561.157185 <br>min 1024.000000 <br>25% 3863.750000 <br>50% 5100.500000 <br>75% 5734.250000 <br>max 8928.000000 <br>Name: # of Website Clicks, dtype: float64 <br><br>count 30.000000 <br>mean 5865.633333 <br>std 1593.176192 <br>min 2472.000000 <br>25% 5275.500000 <br>50% 5829.500000 <br>75% 6805.250000 <br>max 9453.000000 <br>Name: # of Website Clicks, dtype: float64<\/p>\n\n\n\n<pre class=\"EnlighterJSRAW\" data-enlighter-language=\"python\" data-enlighter-theme=\"dracula\" data-enlighter-highlight=\"\" data-enlighter-linenumbers=\"\" data-enlighter-lineoffset=\"\" data-enlighter-title=\"\" data-enlighter-group=\"\">print(a_group['# of View Content'].describe())\nprint(b_group['# of View Content'].describe())<\/pre>\n\n\n\n<p>count 30.000000 <br>mean 1809.933333 <br>std 783.556874 <br>min 104.000000 <br>25% 1508.750000 <br>50% 1906.000000 <br>75% 2204.000000 <br>max 3361.000000 <br>Name: # of View Content, dtype: float64 <br><br>count 30.000000 <br>mean 1873.033333 <br>std 801.055144 <br>min 100.000000 <br>25% 1615.000000 <br>50% 1816.000000 <br>75% 2430.000000 <br>max 3724.000000 <br>Name: # of View Content, dtype: float64<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">\u0410\u043d\u0430\u043b\u0438\u0437 \u0440\u0435\u0437\u0443\u043b\u044c\u0442\u0430\u0442\u043e\u0432<\/h2>\n\n\n\n<pre class=\"EnlighterJSRAW\" data-enlighter-language=\"python\" data-enlighter-theme=\"dracula\" data-enlighter-highlight=\"\" data-enlighter-linenumbers=\"\" data-enlighter-lineoffset=\"\" data-enlighter-title=\"\" data-enlighter-group=\"\">desired_palette = [\"#0099cc\", \"#009900\"]\ndata_all = pd.concat([a_group, b_group])\nfig, ax = plt.subplots(ncols=5, figsize=(34,6))\nax1 = sns.barplot(data=data_all, x='Campaign Name', y='# of Impressions', errorbar=('ci', False), ax=ax[0], estimator='sum', palette=desired_palette)\nax2 = sns.barplot(data=data_all, x='Campaign Name', y='# of Website Clicks', errorbar=('ci', False), ax=ax[1], estimator='sum', palette=desired_palette)\nax3 = sns.barplot(data=data_all, x='Campaign Name', y='# of View Content', errorbar=('ci', False), ax=ax[2], estimator='sum', palette=desired_palette)\nax4 = sns.barplot(data=data_all, x='Campaign Name', y='# of Purchase', errorbar=('ci', False), ax=ax[3], estimator='sum', palette=desired_palette)\nax5 = sns.barplot(data=data_all, x='Campaign Name', y='# Spend [USD]', errorbar=('ci', False), ax=ax[4], estimator='sum', palette=desired_palette)\n\nax1.set_title('Impressions')\nax2.set_title('Clicks')\nax3.set_title('of View Content')\nax4.set_title('Purchase')\nax5.set_title('Spend [USD]')\n\nplt.show()<\/pre>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"2716\" height=\"556\" src=\"https:\/\/dsprog.pro\/wp-content\/uploads\/2023\/08\/rj2khks4hn_4.png\" alt=\"\" class=\"wp-image-230\"\/><\/figure>\n\n\n\n<p>\u041e\u0447\u0435\u0432\u0438\u0434\u043d\u043e, \u0447\u0442\u043e \u043a\u0430\u043c\u043f\u0430\u043d\u0438\u044f B \u044f\u0432\u043b\u044f\u0435\u0442\u0441\u044f \u0431\u043e\u043b\u0435\u0435 \u0440\u0435\u0437\u0443\u043b\u044c\u0442\u0430\u0442\u0438\u0432\u043d\u043e\u0439, \u043f\u043e \u0441\u0440\u0430\u0432\u043d\u0435\u043d\u0438\u044e \u0441 \u043a\u0430\u043c\u043f\u0430\u043d\u0438\u0435\u0439 A. \u041f\u0440\u0438 \u043c\u0435\u043d\u044c\u0448\u0435\u043c \u043a\u043e\u043b\u0438\u0447\u0435\u0441\u0442\u0432\u0435 \u043f\u043e\u043a\u0430\u0437\u043e\u0432 \u043a\u0430\u043c\u043f\u0430\u043d\u0438\u044f B \u0438\u043c\u0435\u0435\u0442 \u0431\u043e\u043b\u044c\u0448\u0435\u0435 \u043a\u043e\u043b\u0438\u0447\u0435\u0441\u0442\u0432\u043e \u043a\u043b\u0438\u043a\u043e\u0432 \u0438 \u0447\u0443\u0442\u044c \u0431\u043e\u043b\u044c\u0448\u0443\u044e \u0432\u0435\u043b\u0438\u0447\u0438\u043d\u0443 \u043f\u0440\u043e\u0434\u0430\u0436. \u041e\u043d \u043f\u0440\u0438\u0432\u043d\u043e\u0441\u0438\u0442 \u0431\u043e\u043b\u044c\u0448\u0443\u044e \u0432\u043e\u0432\u043b\u0435\u0447\u0435\u043d\u043d\u043e\u0441\u0442\u044c \u043f\u043e\u043b\u044c\u0437\u043e\u0432\u0430\u0442\u0435\u043b\u0435\u0439 \u0432 \u043f\u0440\u043e\u0441\u043c\u043e\u0442\u0440 \u043a\u043e\u043d\u0442\u0435\u043d\u0442\u0430 \u0441\u0430\u0439\u0442\u0430. \u041f\u0440\u0438 \u044d\u0442\u043e\u043c \u043a\u0430\u043c\u043f\u0430\u043d\u0438\u044f B \u043d\u0435\u0437\u043d\u0430\u0447\u0438\u0442\u0435\u043b\u044c\u043d\u043e \u0434\u043e\u0440\u043e\u0436\u0435 \u043a\u0430\u043c\u043f\u0430\u043d\u0438\u0438 A.<\/p>\n\n\n\n<p>\u0420\u0430\u0441\u0441\u043c\u043e\u0442\u0440\u0438\u043c \u0442\u0430\u043a\u0436\u0435 \u043f\u0440\u043e\u0438\u0437\u0432\u043e\u0434\u043d\u044b\u0435 \u043f\u043e\u043a\u0430\u0437\u0430\u0442\u0435\u043b\u0438.<\/p>\n\n\n\n<pre class=\"EnlighterJSRAW\" data-enlighter-language=\"python\" data-enlighter-theme=\"dracula\" data-enlighter-highlight=\"\" data-enlighter-linenumbers=\"\" data-enlighter-lineoffset=\"\" data-enlighter-title=\"\" data-enlighter-group=\"\">desired_palette = [\"#0099cc\", \"#009900\"]\ndata_all = pd.concat([a_group, b_group])\nfig, ax = plt.subplots(ncols=4, figsize=(22,6))\nax1 = sns.barplot(data=data_all, x='Campaign Name', y='CTR', errorbar=('ci', False), ax=ax[0], estimator='mean', palette=desired_palette)\nax2 = sns.barplot(data=data_all, x='Campaign Name', y='CR', errorbar=('ci', False), ax=ax[1], estimator='mean', palette=desired_palette)\nax3 = sns.barplot(data=data_all, x='Campaign Name', y='CPC', errorbar=('ci', False), ax=ax[2], estimator='mean', palette=desired_palette)\nax4 = sns.barplot(data=data_all, x='Campaign Name', y='CPA', errorbar=('ci', False), ax=ax[3], estimator='mean', palette=desired_palette)\n# this content is from dsprog.pro\nax1.set_title('CTR')\nax2.set_title('CR')\nax3.set_title('CPC')\nax4.set_title('CPA')\n\nplt.show()<\/pre>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"1795\" height=\"556\" src=\"https:\/\/dsprog.pro\/wp-content\/uploads\/2023\/08\/rj2khks4hn_5.png\" alt=\"\" class=\"wp-image-233\"\/><\/figure>\n\n\n\n<p>.<\/p>\n\n\n\n<p>\u041a\u0430\u043c\u043f\u0430\u043d\u0438\u044f B \u0438\u043c\u0435\u043b\u0430 \u0433\u043e\u0440\u0430\u0437\u0434\u043e \u0431\u043e\u043b\u0435\u0435 \u0432\u044b\u0441\u043e\u043a\u0438\u0439 \u043f\u043e\u043a\u0430\u0437\u0430\u0442\u0435\u043b\u044c CTR ((\u043a\u043e\u043b\u0438\u0447\u0435\u0441\u0442\u0432\u043e \u043a\u043b\u0438\u043a\u043d\u0443\u0432\u0448\u0438\u0445) \/ (\u043a\u043e\u043b\u0438\u0447\u0435\u0441\u0442\u0432\u043e \u043f\u043e\u043a\u0430\u0437\u043e\u0432) * 100). \u041a\u0430\u043c\u043f\u0430\u043d\u0438\u044f B \u0438\u043c\u0435\u0435\u0442 \u043f\u043e\u043a\u0430\u0437\u0430\u0442\u0435\u043b\u044c CR ((\u043a\u043e\u043b\u0438\u0447\u0435\u0441\u0442\u0432\u043e \u043f\u043e\u043a\u0443\u043f\u043e\u043a) \/ (\u043a\u043e\u043b\u0438\u0447\u0435\u0441\u0442\u0432\u043e \u043a\u043b\u0438\u043a\u043d\u0443\u0432\u0448\u0438\u0445) * 100) \u043c\u0435\u043d\u044c\u0448\u0438\u0439 \u0447\u0435\u043c \u0443 \u043a\u0430\u043c\u043f\u0430\u043d\u0438\u0438 A. \u042d\u0442\u043e \u0432\u044b\u0433\u043b\u044f\u0434\u0438\u0442 \u043d\u0435\u0441\u043a\u043e\u043b\u044c\u043a\u043e \u0441\u0442\u0440\u0430\u043d\u043d\u043e. \u041c\u043e\u0436\u0435\u0442 \u043f\u043e\u043a\u0430\u0437\u0430\u0442\u044c\u0441\u044f, \u0447\u0442\u043e \u043a\u0430\u043c\u043f\u0430\u043d\u0438\u044f A \u0431\u043e\u043b\u0435\u0435 \u043f\u0440\u0438\u0432\u043b\u0435\u043a\u0430\u0442\u0435\u043b\u044c\u043d\u0430. \u041d\u043e&#8230; \u043e\u0431\u0440\u0430\u0442\u0438\u0442\u0435 \u0432\u043d\u0438\u043c\u0430\u043d\u0438\u0435, \u0447\u0442\u043e \u043a\u043e\u043b\u0438\u0447\u0435\u0441\u0442\u0432\u043e \u043a\u043b\u0438\u043a\u043e\u0432 \u0443 \u043a\u0430\u043c\u043f\u0430\u043d\u0438\u0438 B <em>\u0433\u043e\u0440\u0430\u0437\u0434\u043e<\/em> \u0431\u043e\u043b\u044c\u0448\u0435, \u0430 \u0440\u0430\u0437\u043d\u0438\u0446\u0430 \u0432 \u043a\u043e\u043b\u0438\u0447\u0435\u0441\u0442\u0432\u0435 \u043f\u0440\u043e\u0434\u0430\u0436 \u0443 \u043a\u0430\u043c\u043f\u0430\u043d\u0438\u0438 B <em>\u043d\u0435\u0437\u043d\u0430\u0447\u0438\u0442\u0435\u043b\u044c\u043d\u043e<\/em> \u0431\u043e\u043b\u044c\u0448\u0435. \u042d\u0442\u043e \u043e\u0431\u044a\u044f\u0441\u043d\u044f\u0435\u0442 \u0434\u0430\u043d\u043d\u0443\u044e \u0441\u0442\u0440\u0430\u043d\u043d\u043e\u0441\u0442\u044c. \u041f\u043e\u043a\u0430\u0437\u0430\u0442\u0435\u043b\u044c CRC ((\u0437\u0430\u0442\u0440\u0430\u0442\u044b \u0432 \u0440\u0443\u0431.) \/ (\u043a\u043e\u043b\u0438\u0447\u0435\u0441\u0442\u0432\u043e \u043a\u043b\u0438\u043a\u043d\u0443\u0432\u0448\u0438\u0445) * 100) \u0438\u043c\u0435\u0435\u0442 \u0442\u0430\u043a\u0443\u044e \u0436\u0435 \u043e\u0441\u043e\u0431\u0435\u043d\u043d\u043e\u0441\u0442\u044c, \u0447\u0442\u043e \u0438 CR. \u041f\u043e\u043a\u0430\u0437\u0430\u0442\u0435\u043b\u044c CPA ((\u0437\u0430\u0442\u0440\u0430\u0442\u044b \u0432 \u0440\u0443\u0431.) \/ (\u043a\u043e\u043b\u0438\u0447\u0435\u0441\u0442\u0432\u043e \u043f\u043e\u043a\u0443\u043f\u043e\u043a) * 100) \u0433\u043e\u0432\u043e\u0440\u0438\u0442 \u043e \u0442\u043e\u043c, \u0447\u0442\u043e \u0437\u0430\u0442\u0440\u0430\u0442\u044b \u043d\u0430 \u043f\u0440\u043e\u0432\u0435\u0434\u0435\u043d\u0438\u0435 \u043a\u0430\u043c\u043f\u0430\u043d\u0438\u0438 B \u0431\u043e\u043b\u0435\u0435 \u043e\u043f\u0440\u0430\u0432\u0434\u0430\u043d\u044b.<\/p>\n\n\n\n<p>\u0418\u0441\u043f\u043e\u043b\u044c\u0437\u0443\u0435\u043c \u0441\u0442\u0430\u0442\u0438\u0441\u0442\u0438\u0447\u0435\u0441\u043a\u0438\u0435 \u0442\u0435\u0441\u0442\u044b \u0434\u043b\u044f \u0443\u0447\u0435\u0442\u0430 \u0440\u0430\u0437\u043b\u0438\u0447\u0438\u0439 \u0432 \u0434\u0430\u043d\u043d\u044b\u0445; \u0432 \u0441\u043e\u0447\u0435\u0442\u0430\u043d\u0438\u0438 \u0441 \u0443\u0440\u043e\u0432\u043d\u044f\u043c\u0438 \u0437\u043d\u0430\u0447\u0438\u043c\u043e\u0441\u0442\u0438 (\u0434\u043b\u044f \u0431\u043e\u043b\u044c\u0448\u0435\u0439 \u0443\u0432\u0435\u0440\u0435\u043d\u043d\u043e\u0441\u0442\u0438 \u0432 \u0440\u0435\u0437\u0443\u043b\u044c\u0442\u0430\u0442\u0430\u0445). \u0414\u043b\u044f \u044d\u0442\u043e\u0433\u043e \u0441\u0444\u043e\u0440\u043c\u0438\u0440\u0443\u0435\u043c \u0444\u0443\u043d\u043a\u0446\u0438\u0438 \u0434\u043e\u0432\u0435\u0440\u0438\u0442\u0435\u043b\u044c\u043d\u044b\u0445 \u0438\u043d\u0442\u0435\u0440\u0432\u0430\u043b\u043e\u0432:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>def ratio_diff_confidence_interval(metric, measure_a, measure_b, alpha)<\/li>\n\n\n\n<li>def cont_diff_confidence_interval(metric, alpha)<\/li>\n<\/ul>\n\n\n\n<p>\u041f\u0440\u043e\u0432\u0435\u0440\u0438\u043c, \u044f\u0432\u043b\u044f\u0435\u0442\u0441\u044f \u043b\u0438 \u0440\u0430\u0437\u043d\u0438\u0446\u0430 \u0432 \u0440\u0430\u0437\u043b\u0438\u0447\u043d\u044b\u0445 \u043f\u043e\u043a\u0430\u0437\u0430\u0442\u0435\u043b\u044f\u0445 \u043c\u0435\u0436\u0434\u0443 \u0434\u0432\u0443\u043c\u044f \u043a\u0430\u043c\u043f\u0430\u043d\u0438\u044f\u043c\u0438 \u0441\u0442\u0430\u0442\u0438\u0441\u0442\u0438\u0447\u0435\u0441\u043a\u0438 \u0437\u043d\u0430\u0447\u0438\u043c\u043e\u0439.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">CTR<a href=\"http:\/\/localhost:8888\/notebooks\/Users\/targetplanet\/Desktop\/dsprog\/dsprog__rj2khks4hn\/dsprog__rj2khks4hn\/A-B_test_online_store__en__rj2khks4hn.ipynb#CTR\"><\/a><\/h2>\n\n\n\n<pre class=\"EnlighterJSRAW\" data-enlighter-language=\"python\" data-enlighter-theme=\"dracula\" data-enlighter-highlight=\"\" data-enlighter-linenumbers=\"\" data-enlighter-lineoffset=\"\" data-enlighter-title=\"\" data-enlighter-group=\"\">ratio_diff_confidence_interval(metric='CTR', \n                    measure_a='# of Website Clicks', \n                    measure_b='# of Impressions', \n                    alpha=.05)<\/pre>\n\n\n\n<p>The difference in CTR between groups is 0.0297 Confidence Interval: [ 0.0293 , 0.0301 ] <br>Reject Null Hypothesis, statistically significant difference between a_group and b_group CTR<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">CR<\/h2>\n\n\n\n<pre class=\"EnlighterJSRAW\" data-enlighter-language=\"python\" data-enlighter-theme=\"dracula\" data-enlighter-highlight=\"\" data-enlighter-linenumbers=\"\" data-enlighter-lineoffset=\"\" data-enlighter-title=\"\" data-enlighter-group=\"\">ratio_diff_confidence_interval(metric='CR', \n                    measure_a='# of Purchase', \n                    measure_b='# of Website Clicks', \n                    alpha=.05)<\/pre>\n\n\n\n<p>The difference in CR between groups is -0.0129 Confidence Interval: [ -0.015 , -0.0109 ] <br>Reject Null Hypothesis, statistically significant difference between a_group and b_group CR<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">CPC<\/h2>\n\n\n\n<pre class=\"EnlighterJSRAW\" data-enlighter-language=\"python\" data-enlighter-theme=\"dracula\" data-enlighter-highlight=\"\" data-enlighter-linenumbers=\"\" data-enlighter-lineoffset=\"\" data-enlighter-title=\"\" data-enlighter-group=\"\">cont_diff_confidence_interval(metric='CPC', alpha=.05)<\/pre>\n\n\n\n<p>The difference in CPC between groups is -0.0981 Confidence Interval: [ -0.2377 , 0.0414 ] <br>Unable to reject Null Hypothesis, no statistically significant difference between a_group and b_group CPC<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">CPA<\/h2>\n\n\n\n<pre class=\"EnlighterJSRAW\" data-enlighter-language=\"python\" data-enlighter-theme=\"dracula\" data-enlighter-highlight=\"\" data-enlighter-linenumbers=\"\" data-enlighter-lineoffset=\"\" data-enlighter-title=\"\" data-enlighter-group=\"\">cont_diff_confidence_interval(metric='CPA', alpha=.05)<\/pre>\n\n\n\n<p>The difference in CPA between groups is -0.5102 Confidence Interval: [ -2.1616 , 1.1413 ] <br>Unable to reject Null Hypothesis, no statistically significant difference between a_group and b_group CPA<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">\u0412\u044b\u0432\u043e\u0434\u044b<\/h2>\n\n\n\n<p>\u041f\u0440\u0438 \u043c\u0435\u043d\u044c\u0448\u0435\u043c \u043a\u043e\u043b\u0438\u0447\u0435\u0441\u0442\u0432\u0435 \u043f\u043e\u043a\u0430\u0437\u043e\u0432 \u043a\u0430\u043c\u043f\u0430\u043d\u0438\u044f B \u0438\u043c\u0435\u0435\u0442 \u0431\u043e\u043b\u044c\u0448\u0435\u0435 \u043a\u043e\u043b\u0438\u0447\u0435\u0441\u0442\u0432\u043e \u043a\u043b\u0438\u043a\u043e\u0432 \u0438 \u0447\u0443\u0442\u044c \u0431\u043e\u043b\u044c\u0448\u0443\u044e \u0432\u0435\u043b\u0438\u0447\u0438\u043d\u0443 \u043f\u0440\u043e\u0434\u0430\u0436. \u041e\u043d \u043f\u0440\u0438\u0432\u043d\u043e\u0441\u0438\u0442 \u0431\u043e\u043b\u044c\u0448\u0443\u044e \u0432\u043e\u0432\u043b\u0435\u0447\u0435\u043d\u043d\u043e\u0441\u0442\u044c \u043f\u043e\u043b\u044c\u0437\u043e\u0432\u0430\u0442\u0435\u043b\u0435\u0439 \u0432 \u043f\u0440\u043e\u0441\u043c\u043e\u0442\u0440 \u043a\u043e\u043d\u0442\u0435\u043d\u0442\u0430 \u0441\u0430\u0439\u0442\u0430. \u041f\u0440\u0438 \u044d\u0442\u043e\u043c \u043a\u0430\u043c\u043f\u0430\u043d\u0438\u044f B \u043d\u0435\u0437\u043d\u0430\u0447\u0438\u0442\u0435\u043b\u044c\u043d\u043e \u0434\u043e\u0440\u043e\u0436\u0435 \u043a\u0430\u043c\u043f\u0430\u043d\u0438\u0438 A.<\/p>\n\n\n\n<p>\u041a\u0430\u043c\u043f\u0430\u043d\u0438\u044f B \u0438\u043c\u0435\u043b\u0430 \u0433\u043e\u0440\u0430\u0437\u0434\u043e \u0431\u043e\u043b\u0435\u0435 \u0432\u044b\u0441\u043e\u043a\u0438\u0439 \u043f\u043e\u043a\u0430\u0437\u0430\u0442\u0435\u043b\u044c CTR ((\u043a\u043e\u043b\u0438\u0447\u0435\u0441\u0442\u0432\u043e \u043a\u043b\u0438\u043a\u043d\u0443\u0432\u0448\u0438\u0445) \/ (\u043a\u043e\u043b\u0438\u0447\u0435\u0441\u0442\u0432\u043e \u043f\u043e\u043a\u0430\u0437\u043e\u0432) * 100). \u041a\u0430\u043c\u043f\u0430\u043d\u0438\u044f B \u0438\u043c\u0435\u0435\u0442 \u043f\u043e\u043a\u0430\u0437\u0430\u0442\u0435\u043b\u044c CR ((\u043a\u043e\u043b\u0438\u0447\u0435\u0441\u0442\u0432\u043e \u043f\u043e\u043a\u0443\u043f\u043e\u043a) \/ (\u043a\u043e\u043b\u0438\u0447\u0435\u0441\u0442\u0432\u043e \u043a\u043b\u0438\u043a\u043d\u0443\u0432\u0448\u0438\u0445) * 100) \u043c\u0435\u043d\u044c\u0448\u0438\u0439 \u0447\u0435\u043c \u0443 \u043a\u0430\u043c\u043f\u0430\u043d\u0438\u0438 A. \u0412\u044b\u0433\u043b\u044f\u0434\u0438\u0442 \u043d\u0435\u0441\u043a\u043e\u043b\u044c\u043a\u043e \u0441\u0442\u0440\u0430\u043d\u043d\u043e. \u041c\u043e\u0436\u0435\u0442 \u043f\u043e\u043a\u0430\u0437\u0430\u0442\u044c\u0441\u044f, \u0447\u0442\u043e \u043a\u0430\u043c\u043f\u0430\u043d\u0438\u044f A \u0431\u043e\u043b\u0435\u0435 \u043f\u0440\u0438\u0432\u043b\u0435\u043a\u0430\u0442\u0435\u043b\u044c\u043d\u0430. \u041d\u043e&#8230; \u043e\u0431\u0440\u0430\u0442\u0438\u0442\u0435 \u0432\u043d\u0438\u043c\u0430\u043d\u0438\u0435, \u0447\u0442\u043e \u043a\u043e\u043b\u0438\u0447\u0435\u0441\u0442\u0432\u043e \u043a\u043b\u0438\u043a\u043e\u0432 \u0443 \u043a\u0430\u043c\u043f\u0430\u043d\u0438\u0438 B <em>\u0433\u043e\u0440\u0430\u0437\u0434\u043e<\/em> \u0431\u043e\u043b\u044c\u0448\u0435, \u0430 \u0440\u0430\u0437\u043d\u0438\u0446\u0430 \u0432 \u043a\u043e\u043b\u0438\u0447\u0435\u0441\u0442\u0432\u0435 \u043f\u0440\u043e\u0434\u0430\u0436 \u0443 \u043a\u0430\u043c\u043f\u0430\u043d\u0438\u0438 B <em>\u043d\u0435\u0437\u043d\u0430\u0447\u0438\u0442\u0435\u043b\u044c\u043d\u043e<\/em> \u0431\u043e\u043b\u044c\u0448\u0435. \u042d\u0442\u043e \u043e\u0431\u044a\u044f\u0441\u043d\u044f\u0435\u0442 \u0434\u0430\u043d\u043d\u0443\u044e \u0441\u0442\u0440\u0430\u043d\u043d\u043e\u0441\u0442\u044c. \u041f\u043e\u043a\u0430\u0437\u0430\u0442\u0435\u043b\u044c CRC ((\u0437\u0430\u0442\u0440\u0430\u0442\u044b \u0432 \u0440\u0443\u0431.) \/ (\u043a\u043e\u043b\u0438\u0447\u0435\u0441\u0442\u0432\u043e \u043a\u043b\u0438\u043a\u043d\u0443\u0432\u0448\u0438\u0445) * 100) \u0438\u043c\u0435\u0435\u0442 \u0442\u0430\u043a\u0443\u044e \u0436\u0435 \u043e\u0441\u043e\u0431\u0435\u043d\u043d\u043e\u0441\u0442\u044c, \u0447\u0442\u043e \u0438 CR. \u041f\u043e\u043a\u0430\u0437\u0430\u0442\u0435\u043b\u044c CPA ((\u0437\u0430\u0442\u0440\u0430\u0442\u044b \u0432 \u0440\u0443\u0431.) \/ (\u043a\u043e\u043b\u0438\u0447\u0435\u0441\u0442\u0432\u043e \u043f\u043e\u043a\u0443\u043f\u043e\u043a) * 100) \u0433\u043e\u0432\u043e\u0440\u0438\u0442 \u043e \u0442\u043e\u043c, \u0447\u0442\u043e \u0437\u0430\u0442\u0440\u0430\u0442\u044b \u043d\u0430 \u043f\u0440\u043e\u0432\u0435\u0434\u0435\u043d\u0438\u0435 \u043a\u0430\u043c\u043f\u0430\u043d\u0438\u0438 B \u0431\u043e\u043b\u0435\u0435 \u043e\u043f\u0440\u0430\u0432\u0434\u0430\u043d\u044b.<\/p>\n\n\n\n<p>\u041c\u043e\u0436\u043d\u043e \u0442\u0430\u043a\u0436\u0435 \u0441\u0434\u0435\u043b\u0430\u0442\u044c \u0441\u043b\u0435\u0434\u0443\u044e\u0449\u0438\u0435 \u0432\u044b\u0432\u043e\u0434\u044b: \u041f\u043e \u043f\u043e\u043a\u0430\u0437\u0430\u0442\u0435\u043b\u044f\u043c CTR, CR \u0432\u043e\u0437\u043c\u043e\u0436\u043d\u043e \u043e\u0442\u043a\u043b\u043e\u043d\u0438\u0442\u044c \u0433\u0438\u043f\u043e\u0442\u0435\u0437\u0443 \u043e \u0440\u0430\u0432\u0435\u043d\u0441\u0442\u0432\u0435 \u044d\u0444\u0444\u0435\u043a\u0442\u043e\u0432 \u043a\u0430\u043c\u043f\u0430\u043d\u0438\u0438 A \u0438 \u043a\u0430\u043c\u043f\u0430\u043d\u0438\u0438 B. \u041f\u0440\u0438\u0447\u0438\u043d\u043e\u0439 \u0437\u0434\u0435\u0441\u044c \u044f\u0432\u043b\u044f\u0435\u0442\u0441\u044f \u0431\u043e\u043b\u044c\u0448\u0430\u044f \u0440\u0430\u0437\u043d\u0438\u0446\u0430 \u0432 \u043a\u043e\u043b\u0438\u0447\u0435\u0441\u0442\u0432\u0435:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>\u043f\u043e\u043a\u0430\u0437\u043e\u0432 (Impressions);<\/li>\n\n\n\n<li>\u043a\u043b\u0438\u043a\u043e\u0432 (of Website Clicks). \u041f\u043e \u043f\u043e\u043a\u0430\u0437\u0430\u0442\u0435\u043b\u044f\u043c CPC, CPA \u043d\u0435\u043b\u044c\u0437\u044f \u043e\u0442\u043a\u043b\u043e\u043d\u0438\u0442\u044c \u0433\u0438\u043f\u043e\u0442\u0435\u0437\u0443 \u043e \u0440\u0430\u0432\u0435\u043d\u0441\u0442\u0432\u0435 \u044d\u0444\u0444\u0435\u043a\u0442\u043e\u0432 \u043a\u0430\u043c\u043f\u0430\u043d\u0438\u0438 A \u0438 \u043a\u0430\u043c\u043f\u0430\u043d\u0438\u0438 B. \u041f\u0440\u0438\u0447\u0438\u043d\u043e\u0439 \u0437\u0434\u0435\u0441\u044c \u044f\u0432\u043b\u044f\u0435\u0442\u0441\u044f \u043d\u0435\u0431\u043e\u043b\u044c\u0448\u0430\u044f \u0440\u0430\u0437\u043d\u0438\u0446\u0430 \u0432 \u043a\u043e\u043b\u0438\u0447\u0435\u0441\u0442\u0432\u0435:<\/li>\n\n\n\n<li>\u0437\u0430\u0442\u0440\u0430\u0442 (Spend |USD|);<\/li>\n\n\n\n<li>\u041f\u043e\u043a\u0443\u043f\u043a\u0438 (of Purchase).<\/li>\n<\/ul>\n\n\n\n<p>\u0412\u0441\u043b\u0435\u0434\u0441\u0442\u0432\u0438\u0435 \u044d\u0442\u043e\u0433\u043e \u043c\u043e\u0436\u043d\u043e \u0437\u0430\u043a\u043b\u044e\u0447\u0438\u0442\u044c \u043e \u0442\u043e\u043c \u0447\u0442\u043e \u043a\u0430\u043c\u043f\u0430\u043d\u0438\u044f B, \u0432 \u0446\u0435\u043b\u043e\u043c, \u0431\u043e\u043b\u0435\u0435 \u044d\u0444\u0444\u0435\u043a\u0442\u0438\u0432\u043d\u0430 \u0447\u0435\u043c \u043a\u0430\u043c\u043f\u0430\u043d\u0438\u044f A.<\/p>\n\n\n\n<p>=======================<br><\/p>\n\n\n\n<p>\u0414\u043b\u044f \u043f\u043e\u043b\u0443\u0447\u0435\u043d\u0438\u044f \u043f\u043e\u043b\u043d\u043e\u0433\u043e \u043a\u043e\u043d\u0442\u0435\u043d\u0442\u0430 \u0434\u0430\u043d\u043d\u043e\u0439 \u0441\u0442\u0430\u0442\u044c\u0438; \u0434\u043b\u044f \u0441\u043e\u0442\u0440\u0443\u0434\u043d\u0438\u0447\u0435\u0441\u0442\u0432\u0430 \u0441 \u0430\u0432\u0442\u043e\u0440\u043e\u043c, \u043f\u0438\u0448\u0438\u0442\u0435 \u0432 \u0422\u0435\u043b\u0435\u0433\u0440\u0430\u043c: cryptosensors<br>\u041f\u043e\u043b\u043d\u044b\u0439 \u043a\u043e\u043d\u0442\u0435\u043d\u0442 \u0434\u0430\u043d\u043d\u043e\u0439 \u0441\u0442\u0430\u0442\u044c\u0438 \u0432\u043a\u043b\u044e\u0447\u0430\u0435\u0442 \u0444\u0430\u0439\u043b\u044b\/\u0434\u0430\u043d\u043d\u044b\u0435:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>\u0444\u0430\u0439\u043b Jupyter Notebook (ipynb),<\/li>\n\n\n\n<li>\u0444\u0430\u0439\u043b\u044b \u0434\u0430\u0442\u0430\u0441\u0435\u0442\u043e\u0432 (csv \u0438\u043b\u0438 xlsx),<\/li>\n\n\n\n<li>\u043d\u0435\u043e\u043f\u0443\u0431\u043b\u0438\u043a\u043e\u0432\u0430\u043d\u043d\u044b\u0435 \u044d\u043b\u0435\u043c\u0435\u043d\u0442\u044b \u043a\u043e\u0434\u0430, \u043d\u044e\u0430\u043d\u0441\u044b.<\/li>\n<\/ul>\n\n\n\n<p>\u0420\u0430\u0441\u043f\u0440\u043e\u0441\u0442\u0440\u0430\u043d\u0435\u043d\u0438\u0435 \u043c\u0430\u0442\u0435\u0440\u0438\u0430\u043b\u043e\u0432 \u0441 dsprog.pro \u0433\u043e\u0440\u044f\u0447\u043e \u043f\u0440\u0438\u0432\u0435\u0442\u0441\u0442\u0432\u0443\u0435\u0442\u0441\u044f (\u0441 \u0443\u043a\u0430\u0437\u0430\u043d\u0438\u0435\u043c \u0441\u0441\u044b\u043b\u043a\u0438 \u043d\u0430 \u0438\u0441\u0442\u043e\u0447\u043d\u0438\u043a).<br><\/p>\n","protected":false},"excerpt":{"rendered":"<p>\u0410\u0432\u0442\u043e\u0440: \u0415\u0432\u0433\u0435\u043d\u0438\u0439 \u0411\u043e\u0434\u044f\u0433\u0438\u043d, https:\/\/dsprog.pro \u0412\u0432\u0435\u0434\u0435\u043d\u0438\u0435 \u0418\u0442\u0430\u043a, \u0441\u0443\u0449\u0435\u0441\u0442\u0432\u0443\u0435\u0442 \u0438\u043d\u0442\u0435\u0440\u043d\u0435\u0442 \u043c\u0430\u0433\u0430\u0437\u0438\u043d (\u0441\u0430\u0439\u0442). \u041e\u043d \u0443\u0436\u0435 \u043f\u0440\u043e\u0432\u043e\u0434\u0438\u0442 \u0440\u0435\u043a\u043b\u0430\u043c\u043d\u0443\u044e \u043a\u0430\u043c\u043f\u0430\u043d\u0438\u044e A. \u0415\u0441\u0442\u044c \u0442\u0430\u043a\u0436\u0435 \u0430\u043b\u044c\u0442\u0435\u0440\u043d\u0430\u0442\u0438\u0432\u043d\u044b\u0439 \u0432\u0430\u0440\u0438\u0430\u043d\u0442: \u043f\u0440\u043e\u0432\u0435\u0441\u0442\u0438 \u0440\u0435\u043a\u043b\u0430\u043c\u043d\u0443\u044e \u043a\u0430\u043c\u0430\u043d\u0438\u044e B. \u041f\u0440\u043e\u0432\u0435\u0434\u0435\u043c A-B \u0442\u0435\u0441\u0442, \u0434\u0430\u0431\u044b \u0432\u044b\u044f\u0441\u043d\u0438\u0442\u044c: \u043e\u0442\u043b\u0438\u0447\u0430\u0435\u0442\u0441\u044f \u043b\u0438 \u044d\u0444\u0444\u0435\u043a\u0442\u0438\u0432\u043d\u043e\u0441\u0442\u044c \u0434\u0430\u043d\u043d\u044b\u0445 \u043a\u0430\u043c\u043f\u0430\u043d\u0438\u0439? \u0414\u0438\u0437\u0430\u0439\u043d \u044d\u043a\u0441\u043f\u0435\u0440\u0438\u043c\u0435\u043d\u0442\u0430 \u041e\u043f\u0440\u0435\u0434\u0435\u043b\u0435\u043d\u0438\u0435 \u0443\u0440\u043e\u0432\u043d\u0435\u0439: \u0437\u043d\u0430\u0447\u0438\u043c\u043e\u0441\u0442\u044c \u0442\u0435\u0441\u0442\u0430 \u0438 \u043c\u043e\u0449\u043d\u043e\u0441\u0442\u044c \u0442\u0435\u0441\u0442\u0430 alpha_zscore: -1.96 beta_zscore: -0.8416 \u041e\u043f\u0440\u0435\u0434\u0435\u043b\u0435\u043d\u0438\u0435 \u043c\u0438\u043d\u0438\u043c\u0430\u043b\u044c\u043d\u043e\u0433\u043e \u0440\u0430\u0437\u043c\u0435\u0440\u0430 \u0432\u044b\u0431\u043e\u0440\u043a\u0438 Sample Size: 54363.0 \u0421\u0442\u0440\u0443\u043a\u0442\u0443\u0440\u0430 [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":262,"comment_status":"closed","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"_locale":"ru_RU","_original_post":"https:\/\/dsprog.pro\/?p=8","footnotes":""},"categories":[8,1,4],"tags":[9,13,12,11,10,16,15,14],"class_list":["post-246","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-a-b-test","category-data-science","category-python","tag-advertising-effectiveness","tag-cpa","tag-cpc","tag-cr","tag-ctr","tag-data-science","tag-determining-minimum-sample-size","tag-hypothesis-testing","ru-RU","entry","has-media"],"_links":{"self":[{"href":"https:\/\/dsprog.pro\/wp-json\/wp\/v2\/posts\/246","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/dsprog.pro\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/dsprog.pro\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/dsprog.pro\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/dsprog.pro\/wp-json\/wp\/v2\/comments?post=246"}],"version-history":[{"count":13,"href":"https:\/\/dsprog.pro\/wp-json\/wp\/v2\/posts\/246\/revisions"}],"predecessor-version":[{"id":363,"href":"https:\/\/dsprog.pro\/wp-json\/wp\/v2\/posts\/246\/revisions\/363"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/dsprog.pro\/wp-json\/wp\/v2\/media\/262"}],"wp:attachment":[{"href":"https:\/\/dsprog.pro\/wp-json\/wp\/v2\/media?parent=246"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/dsprog.pro\/wp-json\/wp\/v2\/categories?post=246"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/dsprog.pro\/wp-json\/wp\/v2\/tags?post=246"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}