Data Science Tech Brief By HackerNoon

Data Science Tech Brief By HackerNoon

By HackerNoonNewsTech News
Download on the App Store

Data Science Tech Brief By HackerNoon episodes

  • Outlier Detection: What You Need to Know

    This story was originally published on HackerNoon at: https://hackernoon.com/outlier-detection-what-you-need-to-know.


    Decisions are usually based on the sample mean, which is very sensitive to outliers and can dramatically change the value. So, it is crucial to manage outliers
    Check more stories related to data-science at: https://hackernoon.com/c/data-science.
    You can also check exclusive content about #outlier-detection, #statistics, #python3, #variance-reducing, #what-is-outlier-detection, #bootstrap, #problem-formulation, #data-analysis, and more.


    This story was written by: @nataliaogneva. Learn more about this writer by checking @nataliaogneva's about page,
    and for more stories, please visit hackernoon.com.


    Analysts often encounter outliers in data during their work. Decisions are usually based on the sample mean, which is very sensitive to outliers. It is crucial to manage outliers to make the correct decision. Let's consider several simple and fast approaches for working with unusual values.

    3 min
  • Instrument Variables and AB Testing – Part 1

    This story was originally published on HackerNoon at: https://hackernoon.com/instrument-variables-and-ab-testing-part-1.


    This article explores the Mathematical details of least squares estimator in an unbiased and biased settings due to model specification errors.
    Check more stories related to data-science at: https://hackernoon.com/c/data-science.
    You can also check exclusive content about #linear-regression, #ab-testing, #casual-analysis, #bias, #multicollinearity, #confounding, #instrument-variables, #instrument-variables-math, and more.


    This story was written by: @varunnakra1. Learn more about this writer by checking @varunnakra1's about page,
    and for more stories, please visit hackernoon.com.


    This article explores the Mathematical details of least squares estimator in an unbiased and biased settings due to model specification errors.

    2 min
  • Using Arrow Flight SQL Protocol in Apache Doris 2.1 For Super Fast Data Transfer

    This story was originally published on HackerNoon at: https://hackernoon.com/using-arrow-flight-sql-protocol-in-apache-doris-21-for-super-fast-data-transfer.


    Apache Doris 2.1 just got a major speed boost with Arrow Flight SQL for up to 10x faster data transfers.
    Check more stories related to data-science at: https://hackernoon.com/c/data-science.
    You can also check exclusive content about #data-science, #database, #data-engineering, #pandas, #python, #apache-arrow, #big-data, #data, and more.


    This story was written by: @frankzzz. Learn more about this writer by checking @frankzzz's about page,
    and for more stories, please visit hackernoon.com.


    Apache Doris 2.1 supports Arrow Flight SQL protocol for reading data from Doris. It delivers tens-fold speedups compared to PyMySQL and Pandas.

    8 min
  • Data Science for Portfolio Optimization: Markowitz Mean-Variance Theory

    This story was originally published on HackerNoon at: https://hackernoon.com/data-science-for-portfolio-optimization-markowitz-mean-variance-theory.


    The theory formulates a mathematical model to optimize the asset allocations to gain the maximum return for a given risk-level.
    Check more stories related to data-science at: https://hackernoon.com/c/data-science.
    You can also check exclusive content about #data-science, #asset-management, #modern-portfolio-theory, #portfolio-optimization, #markowtiz-mean-variance, #what-is-the-markowitz-theory, #portfolio-theory, #investment-portfolio-tips, and more.


    This story was written by: @kustarev. Learn more about this writer by checking @kustarev's about page,
    and for more stories, please visit hackernoon.com.


    An investment portfolio comprises various assets such as stocks and bonds. Every investor starts with a fixed investment capital and decides how much to invest in each asset. Data science techniques such as the Markowitz mean-variance theory help determine the optimal share allocation to build the optimal portfolio.
    The theory formulates a mathematical model to optimize the asset allocations to gain the maximum return for a given risk-level. It analyzes different financial assets and considers their rate of return and risk factors, given their historical trends. The rate of return is an approximation of how much profit the asset will generate over a given time period. The risk factor is quantified using the standard deviation of the asset value. A higher deviation represents a volatile asset and, hence, higher risk.
    The return and risk values are calculated for various portfolio combinations and are represented on the efficient frontier curve. The curve helps investors determine the highest returns against their selected risk.

    6 min
  • 10 Best Datasets for Time Series Analysis

    This story was originally published on HackerNoon at: https://hackernoon.com/10-best-datasets-for-time-series-analysis.


    In order to understand how a certain metric varies over time and to predict future values, we will look at the 10 Best Datasets for Time Series Analysis.
    Check more stories related to data-science at: https://hackernoon.com/c/data-science.
    You can also check exclusive content about #datasets, #ai, #data-science, #data-analysis, #data-analytics, #data-visualization, #hackernoon-datasets, #machine-learning, and more.


    This story was written by: @datasets. Learn more about this writer by checking @datasets's about page,
    and for more stories, please visit hackernoon.com.


    Time series data is essentially a collection of data points organized in time. Time is frequently the independent variable, and the purpose is usually to forecast the future in time series. In this article, we will look at the *10 Best Datasets for Time Series Analysis,* in order to understand how a certain metric varies over time.

    9 min
  • Understanding Scaling Law through Data Science Lenses

    This story was originally published on HackerNoon at: https://hackernoon.com/understanding-scaling-law-through-data-science-lenses.


    Despite the immense promise of LMs, initial endeavors to apply pre-trained LMs to downstream tasks have encountered significant challenges.
    Check more stories related to data-science at: https://hackernoon.com/c/data-science.
    You can also check exclusive content about #data-science, #scaling-law, #artificial-intelligence, #tokenizing-raw-text, #discrete-tokens, #embedding-vector, #token-embeddings, #power-laws, and more.


    This story was written by: @tianchengxu. Learn more about this writer by checking @tianchengxu's about page,
    and for more stories, please visit hackernoon.com.


    Despite the immense promise of LMs as task-neutral foundation models, initial endeavors to apply pre-trained LMs to downstream tasks encountered significant challenges.

    15 min
  • Why PostgreSQL Is the Bedrock for the Future of Data

    This story was originally published on HackerNoon at: https://hackernoon.com/why-postgresql-is-the-bedrock-for-the-future-of-data.


    Explore the rise of PostgreSQL as the de facto database standard, its impact on software development, and the key trends driving its widespread adoption.
    Check more stories related to data-science at: https://hackernoon.com/c/data-science.
    You can also check exclusive content about #data-management, #postgresql, #timescale, #future-of-data-science, #software-development, #database-complexity, #timescaledb, #good-company, #hackernoon-es, #hackernoon-hi, #hackernoon-zh, #hackernoon-fr, #hackernoon-bn, #hackernoon-ru, #hackernoon-vi, #hackernoon-pt, #hackernoon-ja, #hackernoon-de, #hackernoon-ko, #hackernoon-tr, and more.


    This story was written by: @timescale. Learn more about this writer by checking @timescale's about page,
    and for more stories, please visit hackernoon.com.


    PostgreSQL's ascendancy as the go-to database standard is rooted in its adaptability, reliability, and extensive ecosystem. This article delves into the reasons behind its dominance, from tackling database complexity to empowering developers to build the future with confidence. Discover how PostgreSQL is revolutionizing software development and data management practices.

    24 min
  • How to Implement Multi-Group Bar Chart and Interact With Highlighting by Grouping Dimension

    This story was originally published on HackerNoon at: https://hackernoon.com/how-to-implement-multi-group-bar-chart-and-interact-with-highlighting-by-grouping-dimension.


    Solution for implementing a multi-group bar chart similar to the following figure:
    Expect two groups to differentiate in style through color transparency.
    Check more stories related to data-science at: https://hackernoon.com/c/data-science.
    You can also check exclusive content about #visualization, #visactor, #vchart, #multi-group-bar-chart, #grouping-dimensions, #data-science-guide, #vchart-guide, #vchart-tutorial, and more.


    This story was written by: @hacker5022841. Learn more about this writer by checking @hacker5022841's about page,
    and for more stories, please visit hackernoon.com.


    Solution for implementing a multi-group bar chart similar to the following figure:
    Expect two groups to differentiate in style through color transparency.
    When the mouse hovers over a column block, all blocks of the same color are highlighted in linkage.

    2 min
  • Unlocking the Invaluable Role of Big Data in Modern Supply Chain Management

    This story was originally published on HackerNoon at: https://hackernoon.com/unlocking-the-invaluable-role-of-big-data-in-modern-supply-chain-management.


    Let’s take a deeper look at the scale of impact the big data revolution can have for global supply chains and vendor management.
    Check more stories related to data-science at: https://hackernoon.com/c/data-science.
    You can also check exclusive content about #big-data, #supply-chain, #big-data-analytics, #management, #supply-chain-ai, #supply-chain-management, #data-revolution, #supply-chain-efficiency, and more.


    This story was written by: @dmytrospilka. Learn more about this writer by checking @dmytrospilka's about page,
    and for more stories, please visit hackernoon.com.


    Let’s take a deeper look at the scale of impact the big data revolution can have for global supply chains and vendor management.

    8 min
  • Advantages and Disadvantages of Big Data

    This story was originally published on HackerNoon at: https://hackernoon.com/advantages-and-disadvantages-of-big-data.


    Big data may seem like any other buzzword in business, but it’s important to understand how big data benefits a company and how it’s limited.
    Check more stories related to data-science at: https://hackernoon.com/c/data-science.
    You can also check exclusive content about #big-data, #data-science, #data-analysis, #data-analytics, #big-data-analytics, #advantages-of-big-data, #disadvantages-of-big-data, and more.


    This story was written by: @devinpartida. Learn more about this writer by checking @devinpartida's about page,
    and for more stories, please visit hackernoon.com.


    Big data may seem like any other buzzword in business. Still, it’s important to understand how big data benefits a company and how it’s limited. If a company uses big data to its advantage, it can be a major boon for them and help them outperform its competitors. Advantages include improved decision making, reduced costs, increased productivity and enhanced customer service. Disadvantages include cybersecurity risks, talent gaps and compliance complications.

    6 min

About Data Science Tech Brief By HackerNoon

From the publisher's feed

Learn the latest data science updates in the tech world.