Tech Leader Pro

Tech Leader Pro podcast 2024 week 12, the AI training data market place

Listen Later

A marketplace for high-quality training data models for AI is about to emerge, and it will be extremely lucrative.

Notes:

  • A good data model is supposed to represent something in the real world.
  • However, many data models are based on data exclusively from the internet.
  • Just image the downstream consequences of that.
  • For example, a data model based upon social media user-generated content will be full of:
    1. Bias.
    2. Miss-truths and half-truths.
    3. Opinions (some of them dangerous).
    4. Invalidate data with no sources, no peer review...
    5. If a data model is built off bad data, and then that data is used to train an AI, that AI will contain the same bias, miss-truths, dangerous opinions etc.
    6. Getting clean data to drive good decisions, be they human or AI, is becoming increasingly difficult.
    7. We are swamped in data, but the signal-to-noise ratio is low.
    8. The garbage in/garbage out problem has never been greater, and thanks to AI, the downstream consequences have never been higher.
    9. The business opportunity here is great however: a marketplace for high-quality training data models for AI is about to emerge, and it will be extremely lucrative.
    10. Ironically, a return to offline data such as peer-reviewed papers and books may the solution.
    11. Such legacy silos of data will become the new gold rush.
    12. In such a market place, the quality of an AI will be judged by the quality of it's training data.
    13. What I am working on this week:
      • Designing an internet search indexer for the Alpha Framework.
      • Media I am enjoying this week:
        • Diaspora by Greg Egan.

          • Notes and subscription links are here: https://techleader.pro/a/638-Tech-Leader-Pro-podcast-2024-week-12,-the-AI-training-data-market-place

          ...more
          View all episodesView all episodes
          Download on the App Store
          Tech Leader ProBy John Collins