Sign up to save your podcasts
Or
Share How Many Tables are Enough?
Share to email
Share to Facebook
Share to X
Share to email
Share to Facebook
Share to X
Or
How Many Tables are Enough?
Send us a text
The discussion centers on the temptation to import all data into a system during a data project, highlighting several key issues with this approach. Importing all data can create clutter, making it difficult to find relevant information, especially in systems like Dynamics 365 F&O that have thousands of tables. This complexity can lead to inefficiencies and challenges in data retrieval.
Using all available tables can slow down data refresh processes, particularly when clients require frequent updates. Incremental refreshes, while somewhat mitigating this, still involve complex calculations. Overloading users with too much data can overwhelm them, making it harder for them to create their own reports effectively.
Field naming conventions can add to the confusion, especially when fields are coded or not clearly named, making it challenging for untrained users to navigate. Additionally, error handling becomes more difficult with more data, as spotting and fixing errors in numerous fields is more time-consuming.
There's also an environmental consideration; storing and processing unnecessary data consumes significant resources, contributing to environmental concerns. Future data migrations become complicated when unnecessary data is stored, making the process more time-consuming and costly.
The top reasons to avoid importing all data include ensuring data relevance and focus, reducing implementation time and costs, managing processing costs, enhancing security, simplifying error handling, and mitigating environmental impact. The recommendation is to start with the end in mind, identifying necessary reports and working backward to determine essential data, thereby finding a balance and avoiding extremes in data importation.
You can download Power BI Desktop from here.
If you already use Power BI, or are considering it, we strongly recommend you join your local Power BI user group here.
To find out more about our services and the help we can offer, contact us at one of the websites below:
UK and Europe: https://www.clearlycloudy.co.uk/
North America: https://clearlysolutions.net/
View all episodes
By Clearly Podcasting
5
11 ratings
Send us a text
The discussion centers on the temptation to import all data into a system during a data project, highlighting several key issues with this approach. Importing all data can create clutter, making it difficult to find relevant information, especially in systems like Dynamics 365 F&O that have thousands of tables. This complexity can lead to inefficiencies and challenges in data retrieval.
Using all available tables can slow down data refresh processes, particularly when clients require frequent updates. Incremental refreshes, while somewhat mitigating this, still involve complex calculations. Overloading users with too much data can overwhelm them, making it harder for them to create their own reports effectively.
Field naming conventions can add to the confusion, especially when fields are coded or not clearly named, making it challenging for untrained users to navigate. Additionally, error handling becomes more difficult with more data, as spotting and fixing errors in numerous fields is more time-consuming.
There's also an environmental consideration; storing and processing unnecessary data consumes significant resources, contributing to environmental concerns. Future data migrations become complicated when unnecessary data is stored, making the process more time-consuming and costly.
The top reasons to avoid importing all data include ensuring data relevance and focus, reducing implementation time and costs, managing processing costs, enhancing security, simplifying error handling, and mitigating environmental impact. The recommendation is to start with the end in mind, identifying necessary reports and working backward to determine essential data, thereby finding a balance and avoiding extremes in data importation.
You can download Power BI Desktop from here.
If you already use Power BI, or are considering it, we strongly recommend you join your local Power BI user group here.
To find out more about our services and the help we can offer, contact us at one of the websites below:
UK and Europe: https://www.clearlycloudy.co.uk/
North America: https://clearlysolutions.net/